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1. Introduction and preliminaries 

1.1. Overview. We consider a class of zero-sum two-player stochastic games called 
tug-of-war and use them to prove that every bounded real-valued Lipschitz func- 
tion F on a subset Y of a length space X admits a unique absolutely minimal 
(AM) extension to X, i.e., a unique Lipschitz extension u : X — > K for which 
Lip^it = Lip du u for all open U C X \ Y. We present an example that shows 
this is not generally true when F is merely Lipschitz and positive. (Recall that a 
metric space (X, d) is a length space if for all x, y S X, the distance d(x, y) is the 
infimum of the lengths of continuous paths in X that connect x to y. Length spaces 
are more general than geodesic spaces, where the infima need to be achieved.) 

When X is the closure of a bounded domain U C R" and Y is its boundary, a 
Lipschitz extension u of F is AM if and only it is infinity harmonic in the interior 
of X \ Y, i.e., it is a viscosity solution (defined below) to AqqU — 0, where Aoo 
is the so-called infinity Laplacian 

(1.1) AqqM = |Vu|~ 2 u Xt u XiX] u X] 

(informally, this is the second derivative of u in the direction of the gradient of 
u). Aronsson proved this equivalence for smooth u in 1967 and Jensen proved the 
general statement in 1993 [H[T3]- Our analysis of tug-of-war also shows that in this 
setting AqoM = g has a unique viscosity solution (extending F) when g : U — ► R is 
continuous and inf g > or sup g < 0, but not necessarily when g assumes values of 
both signs. We note that in the study of the homogenous equation A K a = 0, the 
normalizing factor |Vu|~ 2 in (jl.l[) is sometimes omitted; however, it is important 
to include it in the nonhomogenous equation. Observe that with the normalization, 
Aqo coincides with the ordinary Laplacian A in the one-dimensional case. 

Unlike the ordinary Laplacian or the p-Laplacian for p < oo, the infinity Lapla- 
cian can be defined on any length space with no additional structure (such as a 
measure or a canonical Markov semigroup) — that is, we will see that viscosity so- 
lutions to AqoU = g are well-defined in this generality. We will establish the above 
stated uniqueness of solutions u to AoqU = g in the setting of length spaces. 

Originally, we were motivated not by the infinity Laplacian but by random turn 
Hex [22] and its generalizations, which led us to consider the tug-of-war game. As 
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we later learned, tug-of-war games have been considered by Lazarus, Loeb, Propp 
and Ullman in [16] (see also [15]). 

Tug-of-war on a metric space is very natural and conceivably applicable (like 
differential game theory) to economic and political modeling. 

The intuition provided by thinking of strategies for tug-of-war yields new results 
even in the classical setting of domains in R™. For instance, in Section [4] we show 
that if u is infinity-harmonic in the unit disk and its boundary values are in [0, 1] 
and supported on a (^-neighborhood of the ternary Cantor set on the unit circle, 
then u(0) < 8@ for some > 0. 

Before precisely stating our main results, we need several definitions. 

1.2. Random turn games and values. We consider two-player, zero-sum random- 
turn games, which are defined by the following parameters: a set X of states of 
the game, two directed transition graphs E\, E\\ with vertex set X, a nonempty 
set Y C X of terminal states (a.k.a. absorbing states), a terminal payoff 
function F : Y — > R, a running payoff function / : X \ Y — ► R, and an initial 
state xq £ X. 

Game play is as follows: a token is initially placed at position xq. At the k th 
step of the game, a fair coin is tossed, and the player who wins the toss may move 
the token to any Xk for which (xk-i, Xk) is a directed edge in her transition graph. 
The game ends the first time Xk G Y, and player Fs payoff is F(xk) + J2i=o f( x i)- 
Player I seeks to maximize this payoff, and since the game is zero-sum, player II 
seeks to minimize it. 

We will use the term tug-of-war (on the graph with edges E) to describe 
the game in which E := E\ — E\\ (i.e., players have identical move options) and E 
is undirected (i.e., all moves are reversible). Generally, our results pertain only to 
the undirected setting. Occasionally, we will also mention some counterexamples 
showing that the corresponding results do not hold in the directed case. 

In the most conventional version of tug-of-war on a graph, Y is a union of "target 
sets" Y l and Y u , there is no running payoff (/ = 0) and F is identically 1 on Y l , 
identically on Y n . Players then try to "tug" the game token to their respective 
targets (and away from their opponent's targets) and the game ends when a target 
is reached. 

A strategy for a player is a way of choosing the player's next move as a function 
of all previously played moves and all previous coin tosses. It is a map from the 
set of partially played games to moves (or in the case of a random strategy, a 
probability distribution on moves). Normally, one would think of a good strategy 
as being Markovian, i.e., as a map from the current state to the next move, but it 
is useful to allow more general strategies that take into account the history. 

Given two strategies <Si,«Sn, let F_(<Si,«Sii) and F + (Si,Su) be the expected total 
payoff (including the running payoffs received) at the termination of the game — if 
the game terminates with probability one and this expectation exists in [—00,00]; 
otherwise, let F-(Si,Su) = —00 and F + (Si,Su) = +00. 

The value of the game for player I is defined as sup^ in£s u ^-(<5i,<5ii). The 
value for player II is infs n sup 5l F + (Si,Su). We use the expressions u\{x) and 
Unix) to denote the values for players I and II, respectively, as a function of the 
starting state x of the game. 

Note that if player I cannot force the game to end almost surely, then u\ = —00, 
and if player II cannot force the game to end almost surely, then un = 00. Clearly, 
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u\{x) < uii(x). When u\(x) = un(x), we say that the game has a value, given by 
u(x) := ui(x) = itii(x). 

Our definition of value for player I penalizes player I severely for not forcing the 
game to terminate with probability one, awarding — oo in this case. 

(As an alternative definition, one could define F_, and hence player I's value, by 
assigning payoffs to all of the non-terminating sequences xq, x\, X2, ■ ■ ■■ If the payoff 
function for the non-terminating games is a zero-sum Borel-measurable function of 
the infinite sequence, then player I's value is equal to player II's value in great 
generality [T7]; see also [5D] for more on stochastic games. The existence of a value 
by our strong definition implies the existence and equality of the values defined by 
these alternative definitions.) 

Considering the two possibilities for the first coin toss yields the following lemma, 
a variant of which appears in [16] . 

Lemma 1.1. The function u = uj satisfies the equation 

(1.2) u(x) = ~( sup u(y)+ inf u(y) ) + f(x) 

* ys/:(x,3/)GEi y-{x,v)eE 2 J 

for every non-terminal state x € X\Y for which the right-hand-side is well-defined, 
andu\(x) = — oo when the right-hand- side is of the form ^(oo + (— oo)) + f(x). The 
analogous statement holds for u\\, except that uu(x) = +oo when the right-hand- 
side of S1.2\) is of the form i(oo + (— oo)) + f(x). 

When E = Ei = E2, the operator 

Aoou(a;) := sup u(y) + inf u(y) — 2u(x) 

y.{x,y)£E y:(x,y)eE 

is called the (discrete) infinity Laplacian. A function u is infinity harmonic 
if (jl.2p holds and f(x) = at all non-terminal x € X \ Y . When u is finite, this 
is equivalent to AqqU = 0. However, it will be convenient to adopt the convention 
that u is infinity harmonic at x if u(x) = +00 (resp. —00) and the right hand side 
in (|1.2| is also +00 (resp. —00). Similarly, it will be convenient to say "u is a 
solution to Aooit = —2 /" at x if u(x) = +00 (resp. —00) and the right hand side 
in (|1.2p is also +00 (resp. —00). 

In a tug-of-war game, it is natural to guess that the value u = u\ = u\\ exists 
and is the unique solution to 

A 00 u(x) = -2/, 

and also that (at least when E is locally finite) player I's optimal strategy will be to 
always move to the vertex that maximizes u(x), and player II's optimal strategy will 
be to always move to the vertex that minimizes u(x). This is easy to prove when 
E is undirected and finite and / is everywhere positive or everywhere negative. 
Subtleties arise in more general cases (X infinite, E directed, F unbounded, / 
having values of both signs, etc.) 

Our first theorem addresses the question of the existence of a value. 

Theorem 1.2. A tug-of-war game with parameters X, E, Y, F, f has a value when- 
ever the following hold: 

(1) Either f — everywhere or inf / > 0. 

(2) inf F > -00. 

(3) E is undirected. 
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Counterexamples exist when any one of the three criteria is removed. In Section[5] 
(a section devoted to counterexamples) we give an example of a tug-of-war game 
without a value, where E is undirected, F = 0, and the running payoff satisfies 
/ > but inf / = 0. 

The case where / = 0, F is bounded, and (A, E) is locally finite was proved 
earlier in [15J . That paper discusses an (essentially non-random) game in which 
the two players bid for the right to choose the next move. That game, called the 
Richman game, has the same value as tug-of-war with / = where F takes the 
values and 1. Additionally, a simple and efficient algorithm for calculating the 
value when / = and (A, E) is finite is presented there. 

1.3. Tug-of-war on a metric space. Consider now the special case that (X, d) 
is a metric space, Y C X, and Lipschitz functions F : Y — > R and / : X \ Y — > R 
are given. Let E e be the edge-set in which x ~ y if and only if d(x, y) < e and let 
u £ be the value (if it exists) of the game played on E £ with terminal payoff F and 
running payoff normalized to be e 2 /. 

In other words, u e {x) is the value of the following two-player zero-sum game, 
called e-tug-of-war: fix xo = x 6 X x Y. At the fc th turn, the players toss a coin 
and the winner chooses an Xk with d(xk, £/s-i) < £■ The game ends when Xk S Y, 
and player Fs payoff is F(x k ) + e 2 Yi=o f( x i)- 

When the limit u := lim £ _>o u £ exists pointwise, we call u the continuum value 
(or just "value") of the quintuple (X, d, Y, F, /). We define the continuum value 
for player I (or II) analogously. 

The reader may wonder why we have chosen not to put an edge in E e between 
x and y when d(x, y) = e exactly. This choice has some technical implications. 
Specifically, we will compare the e-game with the 2 e-game. If x, z are such that 
d(x,z) < 2e, then in a length-space it does not follow that there is a y such 
that d(x,y) < e and d(y, z) < e. However, it does follow if you replace the weak 
inequalities with strong inequalities throughout. 

We prove the following: 

Theorem 1.3. Suppose X is a length space, Y C X is non-empty, F : Y — > R is 
bounded below and has an extension to a uniformly continuous function on X , and 
either f : X \ Y — ► R satisfies f — or all three of the following hold: inf |/| > 
0, / is uniformly continuous, and X has finite diameter. Then the continuum 
value u exists and is a uniformly continuous function extending F. Furthermore, 
\\u — M e ||oo - > as e \ 0. If F is Lipschitz, then so is u. If F and f are Lipschitz, 
then \\u — u £ ||oo = 0(e). 

The above condition that F : Y — > R extends to a uniformly continuous function 
on X is equivalent to having F uniformly continuous on Y and "Lipschitz on large 
scales," as we prove in Lemma T3.9I below. 

We will see in Section 15.11 that this fails in general when / > but inf / = 
0. When / assumes values of both signs, it fails even when AT is a closed disk 
in R 2 , Y is its boundary and F = 0. In Section T5.3I we show by means of an 
example that in such circumstances it may happen that uf ^ ufj and moreover, 
liminf eX o IK _ u nlloo > 0. 

1.4. Absolutely minimal Lipschitz extensions. Given a metric space (X,d), 
a subset Y c X and a function u : X — > R, we write hip Y u = sw P x ,y<£Y \ u {u) ~ 
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u{x)\/d{x,y) and Lipu = Lip^u. Thus u is Lipschitz iff Lipu < oo. Given F : 
Y — > E, we say that u : X — ► E is a minimal extension of F if Lip^u = Lip Y F 
and = F(y) for all i/ey. 

It is well known that for any metric space A, any Lipschitz F on a subset Y 
of X admits a minimal extension. The largest and smallest minimal extensions 
(introduced by McShane [18] and Whitney [24] in the 1930's) are respectively 

inf [F(y) + Lip y F y)] and sup [F(y) — Lip y Fc?(a;, y)] . 

y^ Y ' y < v 

We say u is an absolutely minimal (AM) extension of F if Lip it < oo and 

Lipj/it = Lip ac/ w for every open set U C X \ Y. We say that u is AM on U if it is 
defined on U and is an AM extension of its restriction to dU . AM extensions were 
first introduced by Aronsson in 1967 PQ and have applications in engineering and 
image processing (see [3J for a recent survey). 
We prove the following: 

Theorem 1.4. Let X be a length space and let F : Y — > E be Lipschitz, where 
7^ Y C A. If mi F > — oo, i/iera £/ie continuum value function u described in 
Theorem \1.3\ (with f = 0) is an AM extension of F. If F is also bounded, then u 
is the unique AM extension of F. 

We present in the counterexample section, Section an example in which F is 
Lipschitz, non-negative, and unbounded, and although the continuum value is an 
AM extension, it is not the only AM extension. 

Prior to our work, the existence of AM extensions in the above settings was 
known only for separable length spaces |14j (see also |19)V The uniqueness in 
Theorem [L4] was known only in the case that X is the closure of a bounded domain 
U C 1" and Y = dU. (To deduce this case from Theorem 11.41 one needs to 
replace X by the smallest closed ball containing U, say.) Three uniqueness proofs 
in this setting have been published, by Jensen fTS], by Barles and Busca [5], and 
by Aronsson, Crandall, and Juutinen [3]. The third proof generalizes from the 
Euclidean norm to uniformly convex norms. 

Our proof applies to more general spaces because it invokes no outside theorems 
from analysis (which assume existence of a local Euclidean geometry, a measure, 
a notion of twice differentiability, etc.), and relies only on the structure of A as a 
length space. 

As noted in [2], AM extensions do not generally exist on metric spaces that 
are not length spaces. (For example, if X is the L-shaped region {0} x [0, 1] U 
[0, 1] x {0} C E 2 , with the Euclidean metric, and Y = {(0, 1), (1,0)}, then no non- 
constant F : Y — > E has an AM extension. Indeed, suppose that u : X — > E is 
an AM extension of F : Y -> E. Let a := u(0, 0), b := u(Q, 1) and c := u(l,0). 
Then, considering U = {0} x (0, 1), it follows that u(0, s) = a + s (b — a). Likewise, 
u(s, 0) = a + s (c - a). Now taking U e := {0} x [0, 1) U [0, e) x {0}, we see that 
lim^o Lipy u = \b — a\. Hence |c — a\ < \b — a\. By symmetry, |c — a\ = \b — a\. 
Since F is assumed to be nonconstant, b ^ c, and hence c — a — a — b. Then 
|m(0, s) — u(s, 0)|/ (V2s) = \/2 \b — a\, which contradicts lim^o Lip^u = \b — a\.) 

One property that makes length spaces special is that the Lipschitz norm is 
determined locally. More precisely, if W C X is closed, then either Lip w u = 
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Lip aH/ u or for every S > 




u (y)\ 



: x 



, y e W, < d(x, y) < S \ = Lip 



'w 



u . 



The definition of AM is inspired by the notion that if u is the "tautest possible" 
Lipschitz extension of F, it should be tautest possible on any open V C X \ Y, 
given the values of u on dV and ignoring the rest of the metric space. Without 
locality, the rest of the metric space cannot be ignored (since long-distance effects 
may change the global Lipschitz constant), and the definition of AM is less natural. 
Another important property of length spaces is that the graph distance metric on 
E e scaled by e approximates the original metric, namely, it is within e of d{-, •). 

1.5. Infinity Laplacian on R™. The continuum version of the infinity Laplacian 

is defined for C 2 functions u on domains U C K™ by 



This is the same as r} T Hrj, where H is the Hessian of u and r\ — Vm/|Vw|. Infor- 
mally, AqqU is the second derivative of u in the direction of the gradient of u. If 
Vu{x) = then, A 00 m(cc) is undefined; however, we adopt the convention that if 
the second derivative of u(x) happens to be the same in every direction (i.e, the 
matrix {u XiXj } is A times the identity), then A 00 u(x) = A, which is the second 
derivative in any direction. (As mentioned above, some texts on infinity harmonic 
functions define A m without the normalizing factor |Vu|~ 2 . When discussing vis- 
cosity solutions to AqoU = 0, the two definitions are equivalent. The fact that the 
normalized version is sometimes undefined when Vu = turns out not to matter 
because it is always well-defined at x when ip is a cone function, i.e., it has the 
form a\x — z\ + b for a, b G K and z € K™ with z/i, and viscosity solutions can 
be defined via comparison with cones, see Section 11.61 ) As in the discrete setting, 
u is infinity harmonic if AqoU = 0. 

While discrete infinity- harmonic functions are a recent concept, introduced in 
finite-difference schemes for approximating continuous infinity harmonic functions 
[2T] , related notions of value for stochastic games are of course much older. The 
continuous infinity Laplacian appeared first in the work of Aronsson pQ and has 
been very thoroughly studied [1]. Key motivations for studying this operator are 
the following: 

(1) AM extensions: Aronsson proved that C 2 extensions u on domains U C 
W 1 (of functions F on dU) are infinity harmonic if and only if they are AM. 

(2) p-harmonic functions: As noted by Aronsson pQ, the infinity Laplacian is 
the formal limit, as p — > oo of the (properly normalized) p-Laplacians. Re- 
call that p-harmonic functions, i.e. minimizers u of J \\7u(x)\ p dx subject 
to boundary conditions, solve the Euler- Lagrange equation 



where A is the ordinary Laplacian. Dividing by |Vu| p ~ 2 , we see that (at 
least when |Vu| ^ 0) p-harmonic functions satisfy A p u = 0, where A p := 
Aqo + (p — 2) _1 A; the second term vanishes in the large p limit. It is not 




V • (|Vu| p " 2 



Vm) = 0, 



which can be rewritten 




(Au+{ P ~2)A 00 u) = 0, 
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too hard to see that as p tends to infinity, the Lipschitz norm of any limit 
of the p-harmonic functions extending F will be lApgjjF; so it is natural 
to guess (and was proved in [7]) that as p tends to infinity the p-harmonic 
extensions of F converge to a limit that is both absolutely minimal and a 
viscosity solution to A^u = 0. 

In the above setting, Aronsson also proved that there always exists an AM ex- 
tension, and that in the planar case U C K 2 , there exists at most one C 2 infinity 
harmonic extension; however C 2 infinity harmonic extensions do not always exist 

m 

To define the infinity Laplacian in the non-C 2 setting requires us to consider 
weak solutions; the right notion here is that of viscosity solution, as introduced 
by Crandall and Lions (1983) [TT]. Start by observing that if u and v are C 2 
functions, u(x) — v(x), and v > u in a neighborhood of x, then v — u has a local 
minimum at x, whence A oc v(x) > A qo m(cc) (if both sides of this inequality are 
defined) . This comparison principle (which has analogs for more general degenerate 
elliptic PDEs [5]) suggests that if u is not C 2 , in order to define A 00 m(cc) we want 
to compare it to C 2 functions <p for which A 00 (p(x) is defined. Let S(x) be the 
set of real valued functions ip defined and C 2 in a neighborhood of x for which 
A 00 (p(x) has been defined; that is, either Vip(x) ^ or V<p(x) = and the limit 
A^x) := lim x ^ x 2 v %)l^ x) exists. 

Definition. Let A be a domain in W 1 and let u : A — > K be continuous. Set 

(1.3) A+ u(x) — ini{A 00 ip(x) : <p € S(x) and x is a local minimum of ip — u} . 

Thus u satisfies (u) > g in a domain A, iff every <p g C 2 such that ip — u has 
a local minimum at some x £ X satisfies A^ipi^x) > g(x). In this case u is called 
a viscosity subsolution of A oc (-) = g. Note that if ip £ C 2 , then A^(p — A^ip 
wherever Vt/? =/= 0. 
Similarly, let 

(1.4) A^u^x) — sup{A 00 (/3(x) : ip € S(x) and x is a local maximum of ip — u} . 

and call u a viscosity supersolution of A tx) (-) = g iff A^w < g in A. 

Finally, u is a viscosity solution of Aoo(-) — g if A^u < g < A+m in A (i.e., 
u is both a supersolution and a subsolution). 

Here is a little caveat. At present, we do not know how to show that A^u — g 
in the viscosity sense determines g. For example, if u is Lipschitz, g± and 172 are 
continuous, and A^u — gj holds for j — 1, 2 (in the viscosity sense), how does one 
prove that g\ = 52? 

The following result of Jensen (alluded to above) is now well known [II [131 [1]: 
If A is a domain in W 1 and u : X — > R continuous, then Lip^u = Lip ai/ u < co for 
every bounded open set U C U C A (i.e., u is AM) if and only if u is a viscosity 
solution to AqoU = in A. 

Let A C Y C X , where A is closed, Y ^ and A is a length space. If x G X, 
one can define the oo-harmonic measure of A from x as the infimum of u(x) 
over all functions u : X — > [0, 00) that are Lipschitz on A, AM in A \ Y and satisfy 
u > 1 on A. This quantity will be denoted by cJoo(A) = u>m' Y ' X ' (A). In Section fj] 
we prove 
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Theorem 1.5. Let X be the unit ball in R™, n > 1, let Y = dX , let x be the 

center of the ball, and for each 5 > let As C Y be a spherical cap of radius 5 (of 
dimension n — I). Then 

cS 1 / 3 <lu oc (A s )<CS 1 / 3 1 
where c, C > are absolute constants (which do not depend on n). 

Numerical calculations [H] had suggested that in the setting of the theorem 
u}ao(As) tends to as 5 — > 0, but this was only recently proved [12], and the proof 
did not yield any quantitative information on the rate of decay. In contrast to our 
other theorems in the paper, the proof of this theorem does not use tug-of-war. 
The primary tool is comparison with a specific AM function in R 2 \ {0} with decay 
p— 1/3 discovered by Aronsson [3]. 

1.6. Quadratic comparison on length spaces. To motivate the next definition, 
observe that for continuous functions u : R — > R, the inequality A+ u > reduces to 
convexity. The definition of convexity requiring a function to lie below its chords has 
an analog, comparison with cones, which characterizes infinity-harmonic functions. 
Call the function <p(y) = b\y — z| + c a cone based at z £ R™. For an open U C R n , 
say that a continuous u : U — > R satisfies comparison with cones from above 
on U if for every open W C W C U for every z £ R™ \ W, and for every cone 
tp based at z such that the inequality u < ip holds on dW , the same inequality is 
valid throughout W . Comparison with cones from below is defined similarly 
using the inequality u > tp. 

Jensen [T3] proved that viscosity solutions to A^u — for domains in R n sat- 
isfy comparison with cones (from above and below), and Crandall, Evans, and 
Gariepy [3] proved that a function on R™ is absolutely minimal in a bounded do- 
main U if and only if it satisfies comparison with cones in U. 

Champion and De Pascale [5] adapted this definition to length spaces, where 
cones are replaced by functions of the form ip(x) = bd{x, z) + c where b > 0. Their 
precise definition is as follows. Let U be an open subset of a length-space X and let 
u : U — > R be continuous. Then u is said to satisfy comparison with distance 
functions from above on U if for every open W C U , for every z S X \ W 
for every b > and for every c £ R if u(x) < bd(x, z) + c holds on dW , then it 
also holds in W. The function u is said to satisfy comparison with distance 
functions from below if — u satisfies comparison with distance functions from 
above. Finally, u satisfies comparison with distance functions if it satisfies 
comparison with distance functions from above and from below. 

The following result from [8] will be used in the proof of Theorem 11.41 

Lemma 1.6 ( 8 ]). Let U be an open subset of a length space. A continuous u : 
U —>■ R satisfies comparison with distance functions in U if and only if it is AM in 
U. 

To study the inhomogenous equation A^u = g, because u will in general have 
non-zero second derivative (in its gradient direction), it is natural to extend these 
definitions to comparison with functions that have a quadratic term. 

Definitions. Let Q(r) = ar 2 + br + c with r,a,b,c £ R and let A be a length 
space. 
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• Let z £ X. We call the function (p(x) — Q(d(x, z)) a quadratic distance 
function (centered at z). 

• We say a quadratic distance function (f(x) — Q(d(x,z)) is ^-increasing 
(in distance from z) on an open set V C X if either (1) z £ V and for 
every x € V, we have Q'(d(x, z)) > 0, or (2) z G V and & = and a > 0. 
Similarly, we say a quadratic distance function tp is ^-decreasing on V if 
— ip is ^-increasing on V. 

• If u : U — ► R is a continuous function defined on an open set U in a length 
space X, we say that u satisfies ^-quadratic comparison on U if the 
following two conditions hold: 

(1) (/-QUADRATIC COMPARISON FROM ABOVE: For every open V C V C U 
and ^-increasing quadratic distance function tp on V with quadratic 
term a < inf a6 y gi the inequality p > u on dV implies ip > u on V. 

(2) ^-QUADRATIC COMPARISON FROM below: For every open V <ZV dU 
and ^-decreasing quadratic distance function tp on with quadratic 
term a > sup^y the inequality 93 < u on 9y implies 95 < u on 
V. 

The following theorem is proved in Section [5J 

Theorem 1.7. Let u be a real-valued continuous function on a bounded domain 
U in R", and suppose that g is a continuous function on U . Then u satisfies g- 
quadratic comparison on U if and only if u is a viscosity solution to AqoM = g in 
U. 

This equivalence motivates the study of functions satisfying quadratic compar- 
ison. Note that satisfying A QO w(x) = g{x) in the viscosity sense depends only on 
the local behavior of u near x. We may use Theorem 11.71 to extend the definition 
of Aqo to length spaces; saying that A^u = g on an open subset U of a length 
space if and only if every x S U has a neighborhood V C U on which u satisfies 
g-quadratic comparison. We warn the reader, however, that even for length spaces 
X contained within R, there can be solutions to Aooit = that do not satisfy 
comparison with distance functions, (or 0-quadratic comparison, for that matter): 
for example, X = U = (0, 1) and u{x) — x. The point here is that when we take 
V C (0, 1) and compare u with some function <p on dV, the "appropriate" notion 
of the boundary dV is the boundary in R, not in X. 

The continuum value of the tug-of-war game sometimes gives a construction of 
a function satisfying g-quadratic comparison. We prove: 

Theorem 1.8. Suppose X is a length space, Y C X is non-empty, F : Y — > R is 
uniformly continuous and bounded, and either f : X \ Y — > R satisfies f — or all 
three of the following hold: inf |/| > 0, / is uniformly continuous, and X has finite 
diameter. Then the continuum value u is the unique continuous function satisfying 
(—2f)-quadratic comparison on X \ Y and u = F on Y . Moreover, if it : X — ► R 
is continuous, satisfies u > F onY and (— 2 f) -quadratic comparison from below on 
X \ Y, then u > u throughout X . 

Putting these last two theorems together, we obtain 

Corollary 1.9. Suppose U C R™ is a bounded open set, F : dll — > R is uniformly 
continuous, and /:[/—» R satisfies either f = or else inf / > and f is 
uniformly continuous. Then there is a unique continuous function u : U — * R that 
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is a viscosity solution to Ao^u = —2f on U and satisfies u = F on dll . This unique 
solution is the continuum value of tug-of-war on (U, d, dll, F, f). 

It is easy to verify that F indeed satisfies the assumptions in Theorem 11.81 In 
order to deduce the Corollary, we may take the length space X as a ball in M" 
which contains U and extend F to X \ U, say. Alternatively, we may consider U 
with its intrinsic metric and lift F to the completion of U. 

We present in Section [5] an example showing that the corollary may fail if / 
is permitted to take values of both signs. Specifically, the example describes two 
functions u±,U2 defined in the closed unit disk in R 2 and having boundary values 
identically zero on the unit circle such that with some Lipschitz function g we have 
Aooiij — g for j — 1,2 (in the viscosity sense), while u\ ^ ui- 

The plan of the paper is as follows. Section [5] discusses the discrete tug-of-war 
on graphs and proves Theorem 11.21 and Section [3] deals with tug-of-war on length 
spaces and proves Theorems 11.31 11.41 and 11.81 Section [4] is devoted to estimates of 
oo-harmonic measure. In Section [5j we present a few counter-examples showing 
that some of the assumptions in the theorems we prove are necessary. Section [6] is 
devoted to the proof of Theorem 11.71 Section [7] presents some heuristic argument 
describing what the limiting trajectories of some e-tug-of-war games on domains 
in M™ may look like and states a question regarding the length of the game. We 
conclude with additional open problems in Section [8] 

2. Discrete game value existence 

2.1. Tug-of-war on graphs without running payoffs. In this section, we will 
generally assume E = E\ = E\\ is undirected and connected and / = 0. 

Though we will not use this fact, it is interesting to point out that in the case 
where E is finite, there is a simple algorithm from [15] which calculates the value u 
of the game and proceeds as follows. Assuming the value u{v) is already calculated 
at some set V' D Y of vertices, find a path vq, v%, . . . , Vk, k > 1, with interior vertices 
vi, . . . , Vk-i G X \ V and endpoints vq, £ V' which maximizes (u(vk) — u(vo)) /k 
and set u(vi) — u(vo) + i (u(vk) — u(vo)) /k for i = 1, 2, . . . , k — 1. Repeat as long 
as V ^ X. 

Recall that u\ is the value function for player I. 

Lemma 2.1. Suppose that infy F > —oo and f — 0. Then u\ is the smallest 
oo-harmonic function bounded below on X that extends F. More generally, if v is 
an oo-harmonic function which is bounded from below on X and v > F onY , then 
v > Ui on X . 

Similarly, if F is bounded above on Y, then u\\ is the largest oo-harmonic function 
bounded above on X that extends F. 

Proof. Player I could always try to move closer to some specific point y € Y. Since 
in almost every infinite sequence of fair coin tosses there will be a time when the 
number of tails exceeds the number of heads by d(xo, y), this ensures that the game 
terminates a.s., and we have u\ > infy F > — oo. Suppose that v > F on Y and 
v is oo-harmonic on X. Given S > 0, consider an arbitrary strategy for player I 
and let II play a strategy that at step k (if II wins the coin toss), selects a state 
where v(-) is within 52~ k of its infimum among the states II could move to. We 
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Figure 1. A graph for which the obvious tug-of-war strategy of 
maximizing/minimizing u does poorly. 

will show that the expected payoff for player I is at most v{xq) + S. We may 
assume the game terminates a.s. at a time r < oo. Let {xj}j>o denote the random 
sequence of states encountered in the game. Since v is oo-harmonic, the sequence 
Mfe = v(xkAr) + 82~ k is a supermartingale. Optional sampling and Fatou's lemma 
imply that v(x ) + 6 = M > E[M T ] > E[F(x T )]. Thus m < v. By Lemma ED this 
completes the proof. □ 

Now, we prove the first part of Theorem 11.21 When the graph (X, E) is locally 
finite and Y is finite, this was proven in [Tj)J Thm. 17]. 

Theorem 2.2. Suppose that (X,E) is connected, and 7^1. If F is bounded 
below (or above) on Y and f — 0, then u\ — u\\, so the game has a value. 

Before we prove this, we discuss several counterexamples that occur when the 
conditions of the theorem are not met. First, this theorem can fail if E is directed. 
A trivial counterexample is when X is finite and there is no directed path from the 
initial state to Y . 

If X is infinite and E is directed, then there are counterexamples to Theorem l2.2l 
even when every vertex lies on a directed path towards a terminal state. For exam- 
ple, suppose X = N and Y = {0}, with F(0) = 0. If E consists of directed edges of 
the form (n, n — 1) and (n, n + 2), then II may play so that with positive probability 
the game never terminates, and hence the value for player I is by definition — oo. 

Even in the undirected case, a game may not have a value if F is not bounded 
either from above or below. The reader may check that if X is the integer lattice 
Z 2 and the terminal states are the x-axis with F((x,0)) = x, then the players' 
value functions are given by uj((x, y)) = x— \y\ and ujj((x, y)) = x + \y\. (Roughly 
speaking, this is because, in order to force the game to end in a finite amount of 
time, player I has to "give up" \y\ opportunities to move to the right.) Observe 
also that in this case any linear function which agrees with F on the ir-axis is 
oo-harmonic. 

As a final remark before proving this theorem, let us consider the obvious strategy 
for the two players, namely for player I to always maximize u on her turn and for II 
to always minimize u on her turn. Even when E is (undirected and) locally finite 
and the payoff function satisfies < F < 1, these obvious strategies need not be 
optimal. Consider, e.g., the game shown in Figure [TJ where X C I 2 is given by 
X = {v(k,j) : j = 1,2,...;* = 0,1,..., 2*'}, v(k,j) - (2^k, 1 - 2^ +1 ), and E 
consists of edges of the form {v(k,j),v(k + l,j)} and {v(k, j), v(2k,j + 1)}. The 
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terminal states are on the left and right edges of the square, and the payoff is 1 on 
the left and on the right. Clearly the function u(v(k,j)) = l — k/2^ (the Euclidean 
distance from the right edge of the square) is infinity-harmonic, and by Corollary |2.3l 
below, we have u\ = u = u\\. The obvious strategy for player I is to always move 
left, and for II it is to always move right. Suppose however that player I always 
pulls left and player II always pulls up. It is easy to check that the probability 
that the game ever terminates when starting from v(k,j) is at most 2/(fc + 2) (this 
function is a supermartingale under the corresponding Markov chain). Therefore 
the game continues forever with positive probability, resulting in a payoff of — oo to 
player I. Thus, a near-optimal strategy for player I must be able to force the game 
to end, and must be prepared to make moves which do not maximize u. (This is a 
well known phenomenon, not particular to tug-of-war.) 

Proof of Theorem \2.SX If F is bounded above but not below, then we may ex- 
change the roles of players I and II and negate F to reduce to the case where 
F is bounded below. Since u\ < itn always holds, we just need to show that 
un < u\. Since player I could always pull towards a point in Y and thereby ensure 
that the game terminates, we have u\ > miy F > —oo. Let u = u\ and write 
5(x) = sup,^^ \u(y) — u(x)\. Let Xo,Xi, ... be the sequence of positions of the 
game. For ease of exposition, we begin by assuming that E is locally finite (so 
that the suprema and infima in the definition of the oo-Laplacian definition are 
achieved) and that 8{xq) > 0; later we will remove these assumptions. 

To motivate the following argument, we make a few observations. In order to 
prove that Uu < «i, we need to show that player II can guarantee that the game 
terminates while also making sure that the expected payoff is not much larger than 
u{xq). These are two different goals, and it is not a priori clear how to combine 
them. To resolve this difficulty, observe that 5{xj) is non-decreasing in j if players I 
and II adopt the strategies of maximizing (respectively, minimizing) u at every step. 
As we will later see, this implies that the game terminates a.s. under these strategies. 
On the other hand, if player I deviates from this strategy and thereby reduces S(xj), 
then perhaps player II can spend some turns playing suboptimally with respect to 
u in order to increase 6. Let X :— {x £ X : S(x) > 5(xq)} U Y. For n = 0, 1, 2, . . . 
let j n = max{j < n : Xj S Xq} and v n = Xj n , which is the last position in Xq up to 
time n. We will shortly describe a strategy for II based on the idea of backtracking 
to Xq when not in Xq. If v n x n , we may define a backtracking move from x n 
as any move to a neighbor y n of x n that is closer to v n than x n in the subgraph 
G n C {X,E) spanned by the vertices Xj n , Xj n+ i, . . . , x n . Here, "closer" refers to 
the graph metric of G n . When II plays the backtracking strategy, she backtracks 
whenever not in Xq and plays to a neighbor minimizing u\ when in Xq. 

Now consider the game evolving under any strategy for player I and the back- 
tracking strategy for II. Let d n be the distance from x n to v n in the subgraph G n . 
Set 

m n := u{v n ) + 5{x ) d n . 
It is clear that u(x n ) < m n , because there is a path of length d n from x n to v n in G n 
and the change in u across any edge in this path is less than <5(a:o), by the definition 
of Xq. It is easy to verify that m n is a supermartingale, as follows. If x n € Xq, and 
player I plays, then m n +i < u{x n ) + 6(x n ) = m n + 5(x n ), while if II gets the turn 
then m„ + i = u{x n ) — 5{x n ). If x n ^ Xq and II plays, then m n+ i = m n — 8(xq). If 
%n 4- Xq and player I plays not into Xq, then m n +i < m n + S(xq). The last case to 
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consider is that x n ^ Xq and player I plays into a vertex in Xq. In such a situation, 

m„ + i = u(x n+ i) < u(x n ) + 5(x n ) < m n + S(x ) ■ 

Thus, indeed, m n is a supermartingale (bounded below). Let r denote the first 
time a terminal state is reached (so r = oo if the game does not terminate). By 
the martingale convergence theorem, the limit linin^oo m„ A r exists. But when 
player II plays we have m n +i < m n — S(xq). Therefore, the game must terminate 
with probability 1. The expected outcome of the game thus played is at most 
mo = u(xo)- Consequently, itii < it, which completes the proof in the case where 
E is locally finite and 5(xq) > 0. 

Next, what if E is not locally finite, so that suprema and infima might not be 
achieved? In this case, we fix a small r\ > 0, and use the same strategy as above 
except that if x n € X$ and II gets the turn, she moves to a neighbor at which u 
is at most n2~ n ~ 1 larger than its infimum value among neighbors of x n . In this 
case, m n + rj 2~ n is a supermartingale, and hence the expected payoff is at most 
u(xq) + rj. Since this can be done for any 77 > 0, we again have that Un < u. 

Finally, suppose that S(x ) — 0. Let y S Y ', and let player II pull toward y 
until the first time a vertex Xq with S(xq) > or x* } £ Y is reached. After that, II 
continues as above. Since u(xq) = u(xq), this completes the proof. □ 

Corollary 2.3. If E is connected, 7^0 and sup \F\ < 00, then u = u\ = u\\ is 
the unique bounded 00 -harmonic function agreeing with FonY. 

Proof. This is an immediate consequence of Lemma l2.ll the remark that follows it, 
and Theorem El □ 

EE = {(n,n + l) : n = 0, 1,2, . . . }, Y = {0} and F(0) = 0, then u{n) = n is an 
example of an (unbounded) oo-harmonic function that is different from u. 

2.2. Tug-of-war on graphs with running payoffs. Suppose now that / 7^ 0. 
Then the analog of Theorem 12.21 does not hold without additional assumptions. 
For a simple counterexample, suppose that E is a triangle with self loops at its 
vertices (i.e., a player may opt to remain in the same position), that the vertex vq 
is a terminal vertex with final payoff F(vq) = 0, and the running payoff is given by 
f(vi) = —1 and $(1)2) = 1. Then the function given by u(vq) — 0, u(vi) = a — 1, 
u(v2) = a + 1 is a solution to AqoU = —2/ provided —1 < a < 1. The reader 
may check that uj is the smallest of these functions and un is the largest. The gap 
of 2 between u\ and u\\ appears because a player would have to give up a move 
(sacrificing one) in order to force the game to end. This is analogous to the Z 2 
example given in ^ 32.11 Both players are earning payoffs in the interior of the game, 
and moving to a terminal vertex costs a player a turn. 

One way around this is to assume that / is either uniformly positive or uniformly 
negative, as in the following analog of Theorem 12.21 We now prove the second half 
of Theorem O 

Theorem 2.4. Suppose that E is connected and Y ^ 0. Assume that F is bounded 
below and inf / > 0. Then u\ = u\\. If, additionally, f and F are bounded above, 
then any bounded solution u to Aqo-u = —2/ with the given boundary conditions is 
equal to u. 

Proof. By considering a strategy for player I that always pulls toward a specific 
terminal state y, we see that mix u\ > infy F. By Lemma HTT| A^ui = —2/ on 
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X % Y. Let u be any solution to AooS = - 2/ on X \ F that is bounded below on 
X and has the given boundary values on Y . 

Claim: ujj < u. In proving this, we may assume without loss of generality that 
G \ Y is connected, where G is the graph (X, E). Then if u = oo at some vertex in 
X \ Y, we also have u = oo throughout X \ Y, in which case the claim is obvious. 
Thus, assume that u is finite on X \ Y. Fix 5 £ (0, inf /) and let II use the strategy 
that at step k, if the current state is Xk-i and II wins the coin toss, selects a state 
Xk with u(xk) < inf^ :z ^ 2;fc „ 1 u{z) + 2~ k 5. Then for any strategy chosen by player I, 
the sequence Mf. = u(xk) + 2~ k 5 + X^=o f( x j) i s a supermartingale bounded from 
below, which must converge a.s. to a finite limit. Since inf / > 0, this also forces 
the game to terminate a.s. Let r denote the termination time. Then 



Thus this strategy for II shows that uu(xq) < u(xo) + S. Since 6 > is arbitrary, 
this verifies the claim. In particular, uu < ui in X, so Ujj = Uj. 

Now suppose that supi 7, < oo and sup/ < oo, and u is a bounded solution to 
AqqU = —2/ with the given boundary values. By the claim above, u > u\\ = u\. 
On the other hand, player I can play to maximize or nearly maximize u in every 
move. Under such a strategy, he guarantees that by turn k the expected payoff is 
at least u{xq) — E[Q(fc)] — e, where Q(k) is if the game has terminated by time 
k and u(xk) otherwise. If the expected number of moves played is infinite, the 
expected payoff is infinite. Otherwise, lim^ E[Q(fc)] = 0, since u is bounded. Thus, 
u\i = Uj > u in any case. □ 



3.1. Preliminaries and outline. In this section, we will prove Theorem ll.31 The- 
orem [L8] and Theorem 11.41 Throughout this section, we assume (X,d,Y, F, /) de- 
notes a tug-of-war game, i.e., X is a length space with distance function d, Y C X 
is a nonempty set of terminal states, F : Y —> M is the final payoff function, and 
/ : X \ Y — > M is the running payoff function. We let x^ denote the game state at 
time k in e-tug-of-war. 

It is natural to ask for a continuous-time version of tug-of-war on a length space. 
Precisely and rigorously defining such a game (which would presumably involve 
replacing coin tosses with white noise, making sense of what a continuum no-look- 
ahead strategy means, etc.) is a technical challenge we will not undertake in this 
paper (though we include some discussion of the small-e limiting trajectory of e 
tug-of-war in the finite-dimensional Euclidean case in Section [7]). But we can make 
sense of the continuum game's value function u° by showing that the value function 
u e for the e-step tug-of-war game converges as e — * 0. 

The value functions u e do not satisfy any nice monotonicity properties as e — > 
0. In the next subsection we define two modified versions of tug-of-war whose 
values closely approximate u e , and which do satisfy a monotonicity property along 
sequences of the form e2~ Tl , allowing us to conclude that lim„ u e2 exists. Then 
we show that any such limit is a bounded below viscosity solution to AqqU = —2/, 
and that any viscosity solution bounded below is an upper bound on such a limit, 
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3. Continuum value of tug-of-war on a length space 
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so that any two such limits must be equal, which will allow us to prove that the 
continuum limit u a = lim e u e exists. 

Because the players can move the game state almost as far as e, either player can 
ensure that d(xk,y) is "almost a supermartingale" up until the time that Xk = y- 
When doing calculations it is more convenient to instead work with a related metric 
d £ defined by 

d £ (x, y) := e x (min # steps from x to y using steps of length < e) 

\0 x = y 

\e + e\d{x,y)/e\ x^y 

Since d £ is the graph distance scaled by e, it is in fact a metric, and either player 
may choose to make d E (xk,y) a supermartingale up until the time Xk = y. 

3.2. II-favored tug-of-war and dyadic limits. We define a game called II- 
favored e-tug-of-war that is designed to give a lower bound on player I's expected 
payoff. It is related to ordinary e-step tug-of-war, but II is given additional options, 
and player I's running payoffs are slightly smaller. At the (i + l) st step, player I 
chooses a point z in B e (xi) and a coin is tossed. If player I wins the coin toss, the 
game position moves to a point, of player II's choice, in (B2 £ (z) nF)U {z}. (If 
d(z,Y) > 2e, this means simply moving to z.) If II wins, then the game position 
moves to a point in B2 e {z) of II's choice. The game ends at the first time r for 
which x T G Y. Player I's payoff is then — oo if the game never terminates, and 
otherwise it is 

T 

(3-1) e 2 ^ inf f(y) + F(x T ) 

where Zi is the point that player I targets on the i th turn, and f(y) is defined to be 
zero if y £ Y. We let v £ be the value for player I for this game. Given a strategy 
for player II in the ordinary £-game, player II can easily mimic this strategy in the 
II-favored e-game and do at least as well, so v £ < uf. 

Let w £ be the value for player II of I-favored e-tug-of-war, defined analogously 
but with the roles of player I and player II reversed (i.e., at each move, II selects 
the target less than s units away, instead of player I, etc., and the inf in the running 
payoff term in Equation (|3.I[) is replaced with a sup, and games that never terminate 
have payoff +00). For any e > we have 

v £ < uf < Ufj < w £ . 

Lemma 3.1. For any e > 0, 

v 2£ <v £ <uf< Uu <w £ < w 2£ . 

Proof. We have already noted that v £ < uf < ufj < w £ . We will prove that 
v 2e < v £ ; the inequality w £ < w 2e follows by symmetry. Consider a strategy S 2s 
for II-favored 2e-tug-of-war. We define a strategy Sf for player I for the II-favored 
e game that mimics S 2e as follows. Whenever strategy S 2e would choose a target 
point z, player I "aims" for z for one "round," which we define to be the time until 
one of the players has won the coin toss two more times than the other player. By 
"aiming for z" we mean that player I picks a target point that, in the metric d E , 
is e units closer to z than the current point. With probability 1/2, player I gets 
two surplus moves before II, and then the game position reaches z (or a point in 
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Y n £?4 e (z)) before the game position exits Bi e (z). If player II gets two surplus 
moves before player I, then the game position will be in Bi e (z). (See Figure [21) 
The expected number of moves in this round of the II-favored e game is 4; and the 




Figure 2. At the end of the round, player I reaches the target 
z (or a point in Y n Bi e (z)) with probability at least 1/2, and 
otherwise the state still remains within B^z). During the first 
step of the round, when player I has target z, the running payoff 
is the infimum of / over B2 S {z) C B^^z), and during any step of 
the round the infimum is over a subset of B<± s {z). 

running payoff at each move is an e 2 times the infimum over a ball of radius 2e that 
is a subset of B^ s {z) (as opposed to (2e) 2 times the infimum over the whole ball). 
Hence strategy Sf guarantees for the II-favored e game an expected total payoff 
that is at least as large as what S 2£ guarantees for the II-favored 2e game. □ 

Thus v £ converges along dyadic sequences: v £ ' 2 := ]im n — too v e2 exists. A 
priori the subsequential limit could depend upon the choice of the dyadic sequence, 
i.e., the initial e. 

The same argument can be used to show that v k£ < v £ for positive integers k. 

3.3. Comparing favored and ordinary tug-of-war. We continue with a pre- 
liminary bound on how far apart v £ and w £ can be. Let Lip^F 1 denote the Lipschitz 
constant of F with respect to the restriction of the metric d £ to Y. Since d < d £ , 
the Lipschitz constant Lip y F of F with respect to d upper bounds Lip^F. 

Lemma 3.2. Let e > 0. Suppose that LipyF < oo and either 

(1) / = everywhere, or 

(2) |/| is bounded above and X has finite diameter. 
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F(x r ) + ^£ 2 /(^) 



Then for each x £ X and y € Y , 

v £ (x) > F(y)-2eLyfcF- (hip £ Y F + 2 (e + diamX) sup \f |) d £ (x, y). 

Such an expected payoff is guaranteed for player I if he adopts a pull towards y 
strategy, which at each move attempts to reduce d £ (x t , y) . Similarly a pull towards 
y strategy for II gives, 

w £ {x) < F(y) + 2eLip £ Y F+ (Lipf,F + 2 (e + diamX) sup |/|) d £ (x,y). 

Proof. Let player I use a pull towards y strategy. Let r be the time at which Y 
is reached, which will be finite a.s. The distance d £ (xk,y) is a supermartingale, 
except possibly at the last step, where player II may have moved the game state 
to a terminal point up to a distance of 2e from the target, even if player I wins the 
coin toss. Thus E[d e (x T ,y)] < d £ (x, y) + 2s, whence E[F(x T )] > F(y) - (d £ (x, y) + 
2e) lAp Y F. If / = 0, then this implies v £ (x) > F(y) - (d £ (x,y) + 2e)Lip^F. If 
/ 7^ and X has finite diameter, then the expected number of steps before the game 
terminates is at most the expected time that a simple random walk on the interval 
of integers [0, 1 + [diam(X)/eJ] (with a self-loop added at the right endpoint) takes 
to reach when started at j := d £ (x,y)/e, i.e., at most j (3 + 2 Ldiam(X)/ej — j). 
Hence 

T-l 

E 

> F{y) - (d £ {x,y) + 2e) Lvp £ Y F + j (3 + 2 LdiampO/eJ - j) e 2 min(0, inf /) 

> F(y) - (d £ (x,y) + 2e) Lip £ Y F - d £ (x, y) (2 e + 2 diam(X)) sup|/|. 

This gives the desired lower bound on v £ (x). The symmetric argument gives the 
upper bound for w £ (x). □ 

Next, we show that the lower bound v £ on uf is a good lower bound. 

Lemma 3.3. Suppose F is Lipschitz, and either 

(1) / = everywhere, or 

(2) / is uniformly continuous, X has finite diameter and inf |/| > 0. 

Then \\uf — v £ \\ oa — > as e — > 0. If f is also Lipschitz, then \\uf — v £ \\ oc = 0{e). 

Note that since X is assumed to be a length space, the assumptions imply that 
sign(/) is constant and sup|/| < oo. 

Proof. In order to prove that uf is not much larger than v £ , consider a strategy Si 
for player I in ordinary er-tug-of-war, which achieves an expected payoff of at least 
u\ — e against any strategy for player II. We shortly describe a modified strategy Sf 
for player I playing the Il-favored game, which does almost as well as Si does in the 
ordinary game. To motivate Sf , observe that a turn in the II- favored £-tug-of-war 
can alternatively be described as follows. Suppose that the position at the end of 
the previous turn is x. First, player I gets to make a move to an arbitrary point 
z satisfying d(x, z) < e. Then a coin is tossed. If player II wins the toss, she gets 
to make two steps from z, each of distance less than e. Otherwise, II gets to move 
to an arbitrary point in B 2e (z) n Y, but only if the latter set is nonempty. This 
completes the turn. The strategy Sf is based on the idea that after a win in the 
coin toss by II, player I may use his move to reverse one of the two steps executed 
by II (provided Y has not been reached). 
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As strategy Sf is playing the II-favored game against player II, it keeps track of 
a virtual ordinary game. At the outset, the II-favored game is in state 3?o^ £ls is the 
virtual game. As long as the virtual and the favored game have not ended, each 
turn in the favored game corresponds to a turn in the virtual game, and the virtual 
game uses the same coin tosses as the favored game. In each such turn t, the target 
zf for player I in the favored game is the current state Xt in the ordinary game. If 
player I wins the coin toss, then the new game state xf +l in the favored game is his 
current target zf , which is the state of the virtual game Xt, and the new state of 
the virtual game Xt+i is chosen according to strategy Si applied to the history of 
the virtual game. If player II wins the toss and chooses the new state of the favored 
game to be xf +1 , where necessarily d(xf +l ,Xt) < 2s, then in the virtual game the 
virtual player II chooses the new state x t +i as some point satisfying d(x t +i,x t ) < e 
and d(xt+i, xf +1 ) < e. Induction shows that d(xf,x t ) < e as long as both games 
are running, and thus the described moves are all legal. 

If at some time the virtual game has terminated, but the favored game has not, 
we let player I continue playing the favored game by always pulling towards the 
final state of the virtual game. If the favored game has terminated, for the sake of 
comparison, we continue the virtual game, but this time let player II pull towards 
the final state of the favored game and let player I continue using strategy Si. 

Let be the time at which the favored game has ended, and let r be the time 
at which the ordinary virtual game has ended. By Lemma 13.21 if r < , then 
the conditioned expectation of the remaining running payoffs and final payoff to 
player I in the favored game after time r, given what happened up to time r, is 
at least F(x T ) — 0(e) (here the implicit constant may depend on diamA, Lip^F 
and sup | /|). Likewise, u\ < vf from Lemma 13.11 and the second inequality from 
Lemma 13.21 show that if < r, then the conditioned expectation of the remaining 
running and final payoffs in the virtual game is at most F(x^ s ) + 0(e). 

Set \ — \ e :— sup{|/(ar) - f(x')\ : x,x' € X \ Y, d(x, x') < 2e}. Then A = O(e) 
if / is Lipschitz and lim s _g.o A e = if / is uniformly continuous. At each time 
t < t A r^, since zf — xt, the running payoff in the virtual game and in the favored 
game differ by at most e 2 A. Lemmas 13.11 and 13.21 show that there is a constant C, 
which may depend on X, Y, / and F, but not on e, such that — C < v e < uf < C. 
Thus, in the case where sup / < 0, since Si guarantees a payoff of at least uf(xo) — e, 
we have E[r^ A r] = 0(e~ 2 ). Assume that player II plays the II-favored game (up 
to time t A r^) using a strategy S{\ such that the expected payoff to player I 
who uses Sf is at most v £ + e. Then, in the case where inf / > 0, we will have 
E[tAt^] = 0(e~ 2 ), again. There is a strategy Su for player II in the ordinary game, 
which corresponds to the play of player II in the virtual game when player I uses Si 
and Sf and player II uses Sf in the favored game. (The description of the virtual 
game defines Su for some game histories, and we may take an arbitrary extension 
of this partial strategy to all possible game histories.) The above shows that the 
expected payoff for player I in the ordinary game when player I uses Si and player II 
uses Su differs from the expected payoff for player I in the favored game when 
player I uses Sf and player II uses Sf by at most 0(e) + Ae 2 E[r A t s ] < 0(e + A). 
Thus uf < v £ + 0(e + A). Since uf > v e , the proof is now complete. □ 

Hence under the assumption of Lemma \'S. 31 linin^oo uf 2 = W 2 . 
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3.4. Dyadic limits satisfy quadratic comparison. We start by showing that 
uf almost satisfies (— 2/)-quadratic comparison from above. 

Lemma 3.4. Let e > 0, let V be an open subset of X \ Y and write V s — {x : 
B s (x) C V}. Suppose that ip(x) = Q(d{x,z]) is a quadratic distance function that 
is k-increasing on V , where Q(r) = ar 2 + br + c satisfies 

(3.2) a<-sup/(x). 

x£V c 

Also suppose thatswpy f > or diam(Y) < oo. If the value function uf for player I 
in e-tug-of-war satisfies uf < ip on V\V e , then uf < tp on V e . 

Proof. Fix some 8 > 0. Consider the strategy for player II that from a state 
.Tfc_i € V e at distance r — d(xk-i,z) from z pulls to state z (if r < e) or else 
moves to reduce the distance to z by "almost" e units, enough to ensure that 
Q(d(xk,z)) < Q(r - e) + 52~ k . If r < e, then z e V whence Q(t) = at 2 + c with 
a > 0. In this case, if II wins the toss, then xt — z, whence <p(xk) = Q(0) < Q(r—e). 
Thus for all r > 0, regardless of what strategy player I adopts, 

Efo(s fc ) | x u -i] - S2- k - 1 < Q(r + g) + Q(r ~ £) = Q(r) + ae 2 = <p{x k ^) + ae 2 . 

Setting r := inf{fc : Xk 4- Ve}> we conclude that Mk ■= (p(xkAr) — ae 2 (k At) + 6 2~ k 
is a supermartingale. 

Suppose that player I uses a strategy with expected payoff larger than — oo. (If 
there is no such strategy, the assertion of the Lemma is obvious.) Then t < oo a.s. 
We claim that 

(3.3) E[M T ] < M Q . 

Clearly this holds if r is replaced by r A k. To pass to the limit as k — > oo, consider 
two cases. 

• If a < 0, then since <p is ^-increasing on V, it is also bounded from below on 
V. Consequently, Mk is a supermartingale bounded below, so (|3.3p holds. 

• If a > 0, then supy / < 0, by (|3.2[) . By assumption therefore diamY < 
oo, which implies supy \<p\ < oo. If E[r] = oo, we get E[A/ r ] = — oo, 
and hence (|3 . 3|) holds. On the other hand, if E[r] < oo, then dominated 
convergence gives (|3.3[) . 

Since uf(x T ) < ip(x T ), we deduce that 

r ^ i ED 

u\{x ) < supE ip(x T ) + f(x t ) < supE[M T ] < M = ip(x ) + 5. 



Sl ' t=o 



Si 



where runs over all possible strategies for player I with expected payoff larger 
than — oo. Since S > was arbitrary, the proof is now complete. □ 

In order for uf to satisfy (— 2/)-quadratic comparison (from above), we would 
like to know that if uf < ip on the boundary of an open set, then this (almost) 
holds in a neighborhood of the boundary, so that we can apply the above lemma. 
To do this we prove a uniform Lipschitz lemma: 

Lemma 3.5 (Uniform Lipschitz). Suppose that F is Lipschitz, and either 

(1) f — everywhere, or 

(2) |/| is bounded above and X has finite diameter. 
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Then for each e € (0, diamX), uf and ufj are Lipschitz on X w.r.t. the metric d £ 
with Lipschitz constant depending only on diamX, sup |/| and Lip Y F. 

Proof. By symmetry, it suffices to prove this for uf . Set L : = 3 Lip y F+4 di&mX sup \f\. 
Let x,y G X be distinct. If x,y £ Y, then |wf(a;) — uf(y)\ = \F(x) — F(y)\ < 
LipyF d e (x,y). If x € X \ Y and y e Y, Lemmas ET21 and I5TT1 give 

(3.4) \uf(x)-uf(y)\ = \uf(x)-F(y)\ <Ld e {x lV ), x £ X \Y, yeY. 

Now suppose x, y G X \ Y. Set Y* = Y U {y}, F * = F on Y and F*(y) = uf(y). 
Then, clearly, the value of uf{x) for the game where Y is replaced by Y* and 
F is replaced by F* is the same as for the original game. By (|3.4[) . we have 
Lipy*(F*) < L. Consequently, (|3~4|) gives 

\uf(x)-uf(y)\ = \uf(x)-F*(y)\ < (3 L+2 (e+diamX) sup |/|) d £ (x, y) <ALd £ {x,y), 
which completes the proof. □ 

Lemma 3.6. Suppose F is Lipschitz and inf F > — oo, and either (1) f = 
identically or else (2) inf / > 0, / is uniformly continuous, and X has finite diam- 
eter. Then the subsequential limit v e / 2 — linin^oo v e2 satisfies (—2 f)-quadratic 
comparison on X \ Y . 

Proof. By Theorems 12.21 and 12. 4i uf — ufj, so from Lemma [3.31 we have \\w e — 
v e \\oo — > as e — > 0. Thus lim^oo w e2 " = u 6 / 2 " . 

Note that the hypotheses imply that |/| is bounded. Consider an open V C 
X \ Y and an ^-increasing quadratic distance function iponV with quadratic term 
a < — sup^gy f(y), such that 99 > W 2 °° on 9V. We must show that <p > v e l 2 °° on 

V. Since \\w e — w e ||oo ~* 0, we have by Lemma 13. II that v e2 converges uniformly 
to W 2 . So for any 6 > 0, if n 6 N is large enough, then v e2 < ip + 5 on 
<9V\ Note also that ip is necessarily uniformly continuous on V. (If diamV^ < 00 
or a — 0, this is clear. Otherwise, / = and a < 0. However, a < implies 
that diaml^ < 00, since tp is ★-increasing on V.) Hence, by the uniform Lipschitz 
lemma I3T51 uf 2 < tp + 25 on V x V^-™ for all sufficiently large n £ N, where 
we use the notations of Lemma 13.41 By that lemma uf 2 " < 99 + 2 <5 on all of V. 
Letting n — > 00 and (5 — > shows that v e l 2 satisfies (— 2/)-quadratic comparison 
from above. 

To prove quadratic comparison from below, note that the only assumptions which 
are not symmetric under exchanging the roles of the players are inf F > — 00 and 
inf / > 0. However, we only used these assumptions to prove w £ / 2 = W 2 . 
Consequently, comparison from below follows by symmetry. □ 

3.5. Convergence. 

Lemma 3.7. Suppose that v is continuous and satisfies (—2f)-quadratic compari- 
son from below on X \ Y , and that f is locally bounded below. Let 5 > 0. Then in 
II-favored e-tug-of-war, when player I (using any strategy) targets point Zi on step 
i, player II may play to make M tATe a supermartingale, where 




and T e : 



M{t : d{x t ,Y) < 3e}. 
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Proof. Let z — Zt be the point that player I has targeted at time t. Assume that 
t < t £ . We define the following: 

(1) a := M{f(x) : x G B 2e (z)}, 

(2) A := mf{v(x) : x G P>2 £ (z)} (the infimum value of v that II can guarantee 
if II wins the coin toss), 

(3) /3 := 2!M±d + ae 2 ;and 

(4) Q(r) := -ar 2 + ^M±±^L r + w(z) (Q( ) = Q(2e) = A, Q( e ) = [3, 
and Q" = -2a). 

Player II can play so that E[v(x t ) | z t and all prior events] < (v(z) + A)/2 + <52~*, 
i.e., so that E[M t | zt and prior events] — M t -\ < [3 — v(xt-i). We will show 
that whenever d(x, z) < e we have v(x) > /?, and then it will follow that M is a 
supermartingale. There are two cases to check, depending on whether a > or 
a < 0: 

Suppose a < 0. Note that A < v{z). If w(z) = A, the inequality v(x) > (3 on 
B e {z) follows from a < and the definition of (3. Assume therefore that v(z) > A. 
Then Q'(e) = (A - v(z))/(2e) < 0. Thus Q is decreasing on [0, e]. Let r £ [e,2e] 
be the point where Q attains its minimum in [e, 2 e]. Then Q is decreasing on [0, ro]. 
Set V := B ro (z) \ {z}. We have u(» = Q(0) = Q(d{z,z)) and for a; S aB,. (z) 
we have w(x) > A = Q(2e) > Q(r Q ) = Q(d(x,z)). Thus, u(a;) > Q(d(x,z)) 
for a; S dV. Since ?; satisfies (— 2/)-quadratic comparison from below, and Q" = 
—2a > sup xeV —2 f(x), we get v(x) > Q(d(x,z)) for x G V. In particular, for 
x G -B e (z) one has v(x) > Q(d(x,z)) > Q(e) = [3. 

Now suppose a > 0. The function Lq(x) — —ad(x, z) 2 + a{2e) 2 + A is a lower 
bound for z; on dB2 £ {z), and hence applying (— 2/)-quadratic comparison in B2 £ (z) 
with L (-) gives v(z) > L {z) = A + 4ae 2 . Therefore, Q'(0) = (A - v(z) + 
4ae 2 )/(2e) < 0, which together with Q" < implies that Q is decreasing on [0, 2e\. 
By applying (— 2/)-quadratic comparison on B2 £ {z) \ {z} we see that for x G B £ (z) 
we have w(x) > Q(d(x, z)) > Q(e) = (3. □ 

Lemma 3.8. Suppose that F is Lipschitz, and either 

(1) / = everywhere, or 

(2) |/| is bounded above and X has finite diameter. 

Also suppose that v : X — * R is continuous, satisfies {— 2 f)- quadratic comparison 
from below onX\Y,v>FonY, and mfv > — oo. T/ien w e < u /or aZ/ e. 

Proof. The idea is for player II to make the M defined in Lemma 13.71 a super- 
martingale, but we need to pick a stopping time r such that E[M T ] < Mq while 
v £ (x T ) is unlikely to be much larger than v(x T ). Let W :— {x G X : d(x, Y) > 3e} 
and let t £ be defined as in Lemma [3.71 that is t £ :— inf{< G N : Xt ^ W}. Set 
X £ := sup x ^ VF (u e — v), and let S > 0. We first show 

(3.5) v £ < v + X £ + S . 

In the case that / = 0, the supermartingale M is bounded below, so we can 
choose t = t £ . Player I is compelled to ensure r < oo. Conditional on the game 
up to time r, player I cannot guarantee a conditional expected payoff better than 
v e (x T ) + 5 2~ T < M T + \ £ . Since E[M T ] < M = v(x ) + 5, we get ([3?5]), as desired. 

In the case / ^ 0, we let r„ := t £ A n, where n G N. Then E[M T J < Mq. Note 
that sup?; 6 < oo, follows from diamA < oo, v E < uf and Lemma [3.51 Suppose 
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player II makes M a supermartingale up until time r n . Given play until time r n , 
player II may make sure that the conditional expected payoff to player I is at most 



d2-^+v^x T J + e 2 ^ inf f(y). 

2—1 



Taking expectation and separating into cases in which x Tn € W or not, we get 
v e (x ) < E\v(x T „)+e 2 Y] inf f(y)] +\ e +S 2" r "+Pr[x Tii e W] sup(v e (x)-v(x)) 



w 



Since E[M T J < Mq = v(xq) + 5, this gives 

v E (x ) < v(xo) + S + A £ + Pr[x Tn e W] sup(v E (x) - v{x)) . 

w 

The first term above is < E[M T J < Mq = v(xq) + S, independent of n. Player I 
is compelled to play a strategy that ensures Too is finite a.s., since otherwise the 
payoff is -co < v(x). With such a strategy, Pr[a; Tn € W] — > as n — ► oo, and 
since v is bounded below and supu £ < oo, the last summand tends to as n — > oo. 
Thus, we get (I3.5[) in this case as well. 

Next, we show that limsup e ^ X e < 0. Let y £ Y, and set Q(r) = a r 2 + b r + c, 
where a :— sup|/|, b < b* := —2 sup |/| diamX — LipF, and c := F(y). Let 
ip(x) :— Q(d(x,y)). Then <p(y') < F(y') < v(y') for y' 6 Y. Since v satisfies 
comparison from below and (p is ^-decreasing, we get v(x) > <p(x) on X. Thus, 
if a; € i?3 £ (y), then v(x) > F(y) + b* d(x, y) > F(y) + 3 b* e. In conjunction with 
Lemma l3.5[ this implies that limsup e ^ ^£ — 0- Choosing 6 — e and taking e to 
therefore gives in (13. 5|) lim sup eX ^ uE — v - However, the inequality v 2e < v £ from 
Lemma 13. II implies v e < lira sup e /\^ Q v £ < v, completing the proof. □ 

Proof of Theorem ] l.'ft First, suppose that F is Lipschitz. Let e,e' > 0. Let v := 
hrrin—Kx, v e2 and v' := limn^oo v e 2 . We know that these limits exist from 
Lemma 13.11 Lemma 13.31 tells us that ||uf — u E ||oo - ¥ as e — > 0. Since the 
assumptions of that Lemma are player-symmetric, we likewise get 1 1 fj — w £ |joo — *• 0. 
From Theorems l2.2l and l2.4l (possibly with the roles of the players interchanged) we 
know that uf = ufj, and hence the above gives \\v E — w e ||oo 0. By Lemma 13.11 
v e < v < w e and v e < uf < w £ , and so we conclude that ||i> e — u||oo —> and 
II wf — v\\oo ^ 0. Note that the assumptions imply that sup|/| < oo. Therefore, 
from Lemma 13.51 and ||itj — u||oo — ► we conclude that v is Lipschitz. Precisely 
the same argument gives ||i> e — v||oo = 0(e) if / is also assumed to be Lipschitz, 
and similar estimates also hold for \\v £ — v'\\oo- Note that the assumptions imply 
that F is bounded if / ^ 0. Lemma 13.61 (applied possibly with the roles of the 
players reversed) tells us that v' satisfies (— 2/)-quadratic comparison on X \ Y. 
Clearly inf v' > — oo. (If / = identically, then inf v' > inf F, while if diamJT < oo, 
we may use the fact that v' is Lipschitz.) Thus, Lemma 13.81 implies that v e < v'. 
Consequently, v < v'. By symmetry v' < v, and hence v = v' . This completes the 
proof in the case where F is Lipschitz. 

Using the result of Lemma 13.91 below, we know that for every S > there is a 
Lipschitz Fg : Y — > M such that \\F — FtfHoo < Then the Lipschitz case applies 
to the functions Fg ± S in place of F. Since the game value u e for F is bounded 
between the corresponding value with Fg + 5 and F$ — S, and the latter two values 
differ by 26, the result easily follows. □ 
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Lemma 3.9. Let X be a length space, and let F : Y — ► R be defined on a nonempty 
subset Y C X . The following conditions are equivalent: 

(1) F is uniformly continuous and swp{(F(y) — F{y'))/ max{l, d(y, y')} :y,y' G 
Y} < oo. 

(2) F extends to a uniformly continuous function on X . 

(3) There is a sequence of Lipschitz functions on Y tending to F in \\ ■ W^. 

Proof. We start by assuming 1 and proving 2. Let ip(S) := sup{F(y) — F(y') : 
d{y,y') < S, y,y' S Y\, and (p{t) := supji (p{5)/5 : 6 > t\. We now show that 
]imt\o<p(t) = 0. Let e > 0, and let S e > satisfy ip(8 e ) < e. Such a S e exists 
because F is uniformly continuous. Condition 1 implies that M := swp{ip(5)/5 : 
S > S e } < oo. For t < (s/M) A S e , we have 

<p(t) = sup{ttp(6)/6 :5 E >5> t) V sup{t ip(6)/6 : 5 > 8 E } < ip(6 e ) V (tM) <e, 

which proves that lim^o <p(t) = 0. Two other immediate properties of (p which 
we will use are that F(y) — F(y') < <p(d(y,y')) < <p(d(y,y')) holds for y,y' 6 Y 
and ip(st) > S(p(t) when s G [0,1] and t > 0. It follows that ^ is subadditive: 
<p{a) + <p(b) >a<f(a + b)/(a + b) + b (p(a + b)/(a + b) = ip{a + b) for a, b > 0. 

Now for x £ X set := inf{_F(y) + (p{d{y,x)) : y G V}. Then u = Fon F. 
We now prove 

(3.6) u(x) - u(ar') < ^(d(a;, a;')) 

for x, x' G A". Indeed, let y' G F. Then 

u(x) - F(y') - v(d(y', x')) < F(y') + p(d(y', x)) - F(y') - <p(d(y' , x')) 

= Cp{d{y',x))-<p{d{y',x')). 

Consequently, subadditivity and monotonicity of dp gives 

u(x) - F(y') - $(d(y',x')) < <p(\d(x, y') - d(x', y')\) < <p(d(x,x')). 

Taking the supremum over all y' G Y then implies (|3.6p . Therefore, u is uniformly 
continuous and 2 holds. 

We now assume 2 and prove 3. Let u : X — > K be a uniformly continuous 
extension of f to X. It clearly suffices to approximate u by Lipschitz functions 
on X in || • H^. For x G X let u L {x) := infju^') + Ld(x,x') : x' G X). The 
same argument which was used above to prove (|3.6|) now shows that Lip(itt) < L. 
Clearly, ul(x) < u(x). Let tp(t) := sup{u(x) — u(x') : d{x,x') < i} for t > 0. Since 
X is a length space, </? is subadditive. Let t > and fc := |_d(a;, rc') / . Then 

) -Ld{x,x') < ip(d(x,x')) -Ld(x,x') < <p((k + l)t) -Lkt. 

Taking the supremum over all x' and using the subadditivity of tp therefore gives 

u(x) — Ul(x) < sup((/?((fe + 1) t) — L kt ) < ip(t) + sup A; Op(t) — Lt). 
ken^ ' ken 

Therefore, u(x) — ul(x) < <p(t) once L > (p(t)/t. Since inf t>0 <p(t) = and ul < 
u(x), this proves 3. 

The passage from 3 to 1 is standard, and therefore omitted. This concludes the 
proof. □ 
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Proof of Theorem \1.8l Lemma 13.91 tells us that F extends to a uniformly continu- 
ous function on X and that it can be approximated in |j • ||oo by Lipschitz functions. 
We know from Theorem 11.31 that the continuum value u exists and is uniformly 
continuous. Suppose first that F is Lipschitz. Lemma 13.61 (applied possibly with 
the roles of the players reversed) says that u satisfies (— 2/)-quadratic comparison 
on X \ Y. If F is not Lipschitz, we may deduce the same result by approximating 
F from below by Lipschitz functions and observing that a monotone nondecreas- 
ing || • Hoc-limit of functions satisfying (— 2/)-quadratic comparison from above also 
satisfies (— 2/)-quadratic comparison from above, and making the symmetric argu- 
ment for comparison from below. Now suppose that u is as in the second part of the 
theorem. This clearly implies inf u > — oo. Now Lemma l3. 81 gives u < u (again, we 
may need to first approximate F by Lipschitz functions). The uniqueness follows 
directly. □ 



Proof of Theorem \l.J\ If x £ X\Y and y £ Y, then from Lemma f3.2l it follows that 
\u(x) — u(y)\ < LipyF d(x, y). Let U C X \ Y be open and define F*(x) — u(x) 
for x £ Y U dU. It is clear that the continuum value u* of (X, d,Y U dU, F*,0) is 
the same as u, since any player may first play a strategy that is appropriate for the 
(X, d,Y U dU, F*, 0) game and once Y U dU is hit start playing a strategy that is 
appropriate for the original game. The above argument shows that \u(x) — u(y)\ < 
d(x, y) hip gu u if y £ dU and x £ U. In particular, ~Lip auu { x jii — hip du u, which 
implies Lip^u = Lip^u; that is, u is AM in X \ Y. 

Now suppose that u* : X — + E is an AM extension of F and sup|F| < oo. 
Lemma ll.6l tells us that u* satisfies comparison with distance functions. Observe 
that the proof of Lemma 13.81 shows that in the case / = we may replace the 
hypothesis that v satisfies 0-quadratic comparison from below on X \ Y by the 
hypothesis that v satisfies comparison with distance functions from below (since 
only comparisons with distance functions are used in this case). Thus, u < u* . 
Similarly, u > u*, which implies the required uniqueness statement and completes 
the proof. □ 

4. Harmonic measure for A^, 

Here, we present a few estimates of the oo-harmonic measure Woo . Before proving 
Theorem 11.51 we consider the oo-harmonic of porous sets. Recall that a set S in 
a metric space Z is a-porous if for every r £ (0, diamZ) every ball of radius r 
contains a ball of radius ar that is disjoint from S. An example of a porous set 
is the ternary Cantor set in [0, 1]. We start with a general lemma in the setting of 
length spaces. 

Lemma 4.1. Suppose X is a length space and < F < 1 on the terminal states Y , 
where F : Y — > K is continuous. Let S := suppF. Suppose that for some integer k 
and positive constants eo, d m i n and 7 £ (0, 1), for every x £ X with d(x, S) > d m i n , 
there is a sequence of points x — zq, . . . , Zk such that Zk £ Y, F(zk) = 0, and 

dfe, S) > 2 d(zi, Zi-x) + 2 e + 7 d(z , S) 

for i = 1, . . . , k. Then the AM extension u of F satisfies 

< U{X) < (1 - 2 - fc ) l0 ST( d -n/d(^,S))_ 

Proof. We will obtain bounds on u £ (x) that are independent of e (as long as e £ 
(0, £0)), and these yield bounds on u(x). Since u e > 0, we need only give a good 



TUG-OF-WAR AND THE INFINITY LAPLACIAN 



25 



strategy for player II to obtain an upper bound on u £ (x). The idea is for player II 
to always have a "plan" for reaching a terminal state at which F is while staying 
away from the terminal states at which F is nonzero. A plan consists of a sequence 
of points zq, z\, . . . , Zk, where zq is the game state when the plan was formed, 
Zk G Y, and F(zk) = 0. As soon as the game state reaches Zi, player II starts 
pulling towards Zj+i. If player I is lucky and gets many moves, player II may have 
to give up on the plan and form a new plan. When tugging towards z\, we suppose 
that player II gives up and forms a new plan as soon as d e (xt,Zi) — 2d E (zi, 
and otherwise plays to ensure that d e (xt,Zi) is a supermartingalc. While tugging 
towards Zi, the plan will be aborted at that stage with probability at most 1/2, so 
with probability at least 2~ k the plan is never aborted and succeeds in reaching Zk- 
Suppose player II aborts the plan at time t while tugging towards z+, and forms 
a new plan starting at z' = Xf. Then d(xt,Zi) < d e (xt,Zi) — 2d e (zi 1 Zi-\) < 
2d(zi,Zi-i) + 2s, so 

d(x t , S) > d(zi,S) - d(x t ,Zi) > d(zi, S) - [2d(zi, z»-i) + 2e] > jd(zo,S), 

so the game state remains far from S. Since player II can always find a short plan 
(length at most k) when the distance from S is at least <i m i n , player I gets to S 
with probability at most (1 — 2~ k ) l lo s-y(dmin/d(xo,S))~\ ^ w j 1 j c j 1 yields the desired upper 
bound. □ 

The reader may wish to check that the lemma implies lim^o ajac^Ag) = in the 
setting of Theorem II .51 (i.e., when X is the unit ball in R n , n > 1, Y = dX and Ag 
is a spherical cap of radius 6.) 

We are now ready to state and prove an upper bound on the oo-harmonic measure 
of neighborhoods of porous sets. 

Theorem 4.2. Let X C K n , n > 1, be the closed unit ball and let Y be its boundary, 
the unit sphere. Let a € (0, 1/2) and let 5 > 0. Let S be an a-porous subset ofY, 
and let S$ be the closure of the 6 -neighborhood of S. Then 

Of course, in the above, S is a-porous as a subset of Y. (Every subset of Y is 
(l/3)-porous as a subset of A.) 

Proof. The plan is to use the lemma, of course. Let d m i n := 2 S/a. Let zq G X \ Y, 
and suppose that do := d(z , S) > d m i n . Let y G Y be a closest point to z on Y. 
Inside Bd Q (y ) n Y there is a point yi such that B a d (yi) H S = 0. (See Figure[3l) 
Therefore, d(yi, S§) > ado — S > ado/2. We define the sequence zj inductively, as 
follows. If d(zj,S$) > 3d(zj,Y), then we take Zj+i to be any closest point to Zj 
on Y. Otherwise, let zj+i be the point on the line segment from Zj to y% whose 
distance from Zj is d(zj,yi)/10. It can be checked that after k = 0{— log a) steps 
the sequence hits Y \ S and that the assumptions of the lemma hold with this k, 
with 7 = a/10 and with some Sq > 0, independent of zq. The theorem now easily 
follows from the lemma. □ 

We now proceed to study the oo-harmonic measure of spherical caps. 

Proof of Theorem \1.5\ It turns out to be more convenient to work with — As = 
{—y '■ V G As} in place of As. By an obvious comparison argument, it is sufficient 



20 



YUVAL PERES, ODED SCHRAMM, SCOTT SHEFFIELD, AND DAVID B. WILSON 



yd"" . - 
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Figure 3. The terminal states are the unit sphere, and the sup- 
port of F is Ss, the ^-neighborhood of a porous set on the unit 
sphere. From a starting point zq, player II finds a point y\ on the 
sphere that is near the closest point yo on the sphere but far from 
Ss- Player II then tugs towards j/i along a sequence of points, and 
then when it gets much closer to the sphere than to Ss, it tugs 
straight to the sphere. 



to estimate u(0) where u = ug is the AM function in X \ Y with boundary values 

F(V) ■■={(>, d(y,-A s )>6, 

l-d(y,-A s )6- 1 , 0<d(y,-A s )<5. 

The function u is invariant under rotations of X preserving (1,0,..., 0) £ M. n . 
Therefore, u is also AM in M 2 n X. Thus, we henceforth restrict to the case n = 2, 
with no loss of generality. 

Aronsson [3] constructed a family of viscosity solutions G m to AooU = in 
M 2 \ {0} that are separable in polar coordinates: G m (r, 9) = r m ^ 2m_1 ^/i m (0) (for 
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m G Z). We are interested in the m = — 1 solution, which may be written as 

cos 6»(1 - |tan((9/2)| 4 / 3 ) 2 



-1/3 



(4 " Ll G 1 + | tan(6»/2)| 4 / 3 + | tan(6»/2) | 8 / 3 _ 

Observe that when — 7r/2 < 8 < n/2 this solution is non-negative, and G > cr -1 / 3 
when 8 G [— 7r/4, 7r/4], say, where c > is some fixed constant. Then F < 0(1) Gs, 
where 

G 5 (x,y) = 8 l ' 3 G{x + l + 2S,y). 

Since u(0) is monotone in F, and Gs satisfies A x Gs = 0, it follows that u(0) < 
O(l)G s (0) = O(S 1 / 3 ). 

We now show that the bound it(0) = 0(S 1 ^ 3 ) is tight. It is easy to see, using 
comparison with a cone centered at (—1, 0), say, that u(— 1 + 5/10, 0) > c > 0, where 
c is a constant that does not depend on 6. Comparison with a cone centered at any 
point z in the unit disk shows that u(z') > u(z)/2 if \z — z'\ < (1 — |z|)/2. Using 
such estimates, it is easy to see that there is a constant d > such that u > d on 
the disk B of radius S centered at q := (— 1 + 2(5,0), provided that 5 < 1/4, say. 
Now consider the function 

G* s (x,y)=c'6 1 / 3 G((x,y)-q). 

By the choice of the constant d, we have G* s < u on <9i3, since G < r -1 / 3 in R 2 \{0}. 
If (r',8 1 ) denote the polar coordinates centered at q, the center of B, and (r, ff) 
denote the standard polar coordinates centered at 0, then 2 \8'\ > ir — \8 — tt\ when 
r = 1 and we choose 8' E [— tt,tt). Also, r' is bounded from below by a constant 
times \8 - tt| when fl G [0, 2tt] and r = 1. Since |G| < 0(1) ((tt/2) - |6»|) r" 1 / 3 when 
G [— 7r, 7r), it follows that on the unit circle 

Gs < 0(1) ((tt/2) - \8'\) (r')^ 1/3 < 0(1) S 1/3 \8 - ir\ 2 ' 3 < 0(S^ 3 ) . 

Therefore G% - 0{S^ 3 ) < u on the boundary of the unit circle, as well as on dB. 
Consequently, u > G* s — 0(S 1 ^ 3 ) in the complement of B in the unit disk. This 
implies that there is some r G (0, 1) such that us{—r, 0) > S^ 1 ^ 3 for all sufficiently 
small 8. The required estimate u$(0) > 0(<5 -1 / 3 ) now follows by several applications 
of comparison with cones (the number of which depends on r), similar to the above 
argument estimating a lower bound for u on B. □ 

One could also try to use Aronsson's other solutions G m to bound oo-harmonic 
measure of certain sets in other domains. Also, Aronsson has some explicit solutions 
for A p u = 0, which may serve a similar purpose. 

5. Counterexamples 

5.1. Tug-of-war games with positive payoffs and no value. Here we give the 
promised counterexample showing that the hypothesis inf / > in Theorem 11.21 
cannot be relaxed to / > 0. As we later point out, a similar construction works in 
the continuum setting of length spaces. 

The comb game is tug-of-war with running payoffs on an infinite graph shaped 
like a comb, as shown in Figure [4] The comb is defined by an infinite sequence of 
positive integers £q,£i,£2 ■ ■ ., and has states (vertices) {(x, y) G 1? : < x and < 
y < ix\. The edges of the comb are of the form (x,y) ~ (x, y + 1) and (x,0) ~ 
(x + 1,0), giving the graph the shape of a comb, where the x th tooth of the comb 
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has length l x . The running payoff f(x, y) is l/£ x if y = and zero otherwise. (Later 
we will consider a variation where / > everywhere.) The terminal states are the 
states of the form (x,£ x ), and the terminal payoff F is zero on all terminal states. 



Figure 4. A comb. 



Lemma 5.1. For any comb (choice of the sequence {£ x }), we have ui(0, 0) = 2. 

Proof. First we argue that iti(0,0) > 2. Denote by ip(t) :— Y^l=o f( x i> Hi) the 
accumulated running payoff. Fix a large B > and equip player I with the following 
strategy: at all times t < r for which ip(t) < B, player 1 pulls down if y t ^ 0, left 
if yt — and x t ^ 0, and right if (xt,yt) — (0,0); if ip(xt) > B, then player I pulls 
toward the closest terminal state. Define the termination time r = inf{£ : y t — £ Xt } 
and also the stopping time (T = inf{i : x t = 0} A r. Fix any strategy for player II 
and observe that {xtK& }t>o is a nonnegative supcrmartingalc, which must converge 
a.s.; therefore, from any initial state, Co < 00 a - s -5 therefore, the stopping time 
o~ = inf{t : ip(t) > B} A r is almost surely finite, whence r < oo a.s. as well. 
Consider the process 

M t = 2(l-y t /e xt ) +iP(t). 

Then M tAcr is a submartingale. Note that if y a — then M a — ip(a) + 2 and > 
B, while if y a > then a — r and M a — ip(cr). In any case, M a < tp(a)(l + 2/B). 
Thus by optional stopping, 

2 = M < EM a < (1 + -1)^^) < (1 + °)- 

Next, to show that mi(0,0) < 2, suppose that player II adopts the strategy 
of always pulling up, and player I knows this and seeks to maximize her payoff. 
Because player II always pulls up, M t is a positive supermartingale, so M t a.s. 
converges to M^, and by optional stopping, 

oo 

2(l-y /£ X0 ) = M >E[M oo ]>E[^2f(x t ,, Vt ,)]. 

t'=0 

This shows that by always pulling up, player II can force player I's expected payoff 
from (x ,yo) = (0,0) to be no more than 2(1 — yo/£ Xo ) = 2. □ 
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Remark 5.2. Note that the strategy for player II of always pulling up does not neces- 
sarily force the game to end with probability one; this strategy always gives an upper 
bound on ui(0, 0), but it only yields an upper bound on un(0, 0) if J2 x >o 1 = 00 > 
when the Borcl-Cantclli Lemma ensures termination. 

Suppose that the teeth of the comb arc long, i.e. X^o^x* < 00 > an< ^ that 
player I plays the strategy of always pulling down if y t > and always pulling right 
if yt — 0. If player II plays the strategy of always pulling up, then we may calculate 
the probability that the game terminates when started in state (x,0). Either the 
state goes to the terminal state of the tooth or goes to the base of the next tooth, 
and the latter probability is £ x /{£ x + 1). When the teeth of the comb are long, 
the game lasts forever with probability rix>o {£x + 1) > 0. If player II needs to 
ensure that the game terminates, she will need to be prepared to sometimes pull 
left instead of up, and this necessity will be costly for player II. 

Lemma 5.3. For every s > there is a suitable comb (choice of the sequence {£ x }) 
such that uii(0, 0) > s. 

Proof. Let player I play the strategy of pulling down when y > and pulling to the 
right when y = 0. We will estimate from below the expected payoff when player II 
plays any strategy which guarantees that the game terminates in finite time a.s. 
against the above strategy for player I. Let a x denote the probability that the game 
terminates at the terminal state (x,£ x ). Then ax = ^ F° r evei T x e N let 

L x , U x and R x denote the expected number of game transitions from (x,0) to the 
left, upwards and to the right, respectively (that is, to (x — 1,0), to (x, 1) and to 
(x + 1, 0), respectively). 
First, observe that 

U x ^ a x i x , 

because every time that the game state arrives at (x, 1), with conditional probability 
at most l/£ x the game terminates at (x, £ x ) before returning to (x, 0). Next, observe 
that 

L x +i > R x — 1 1 

because the number of transitions from (x, 0) to (x + 1, 0) can exceed the number 
of transitions from (x + 1,0) to (x,0) by at most one. (More precisely, we have 
Lx+i = R x ~ J2j> x a h but this wm n °t b e needed.) Finally, note that 

R x ^ L x + U x , 

because player I always pulls right at (x, 0). (We set Lq := 0.) 
An easy induction shows that the above relations imply 



Rx > a 

3=0 



rj x • 



The expected payoff £ satisfies 



E 



Rx + L x + U x R x 



x =0 * X =0 

We plug in the above lower bound on R x to obtain 

" (i 



^£^(£?)-£f 

j=Q x =j x x=0 x 
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Since ^2 x>0 a x — 1, the lemma follows if we choose £ x — (c + x) 3 with c > 
sufficiently large. □ 

Note that when player II always pulls up, for every vertex v in the comb there 
is a finite upper bound b(v) on the expected number of visits to v , which holds 
regardless of the strategy used by player I. Since in the proof of Lemma [5 . 1 1 player II 
always pulls up, it follows that the value for player I is at most 3 even when / is 
replaced by /(•) +?(•)/(&(') + l)> where q > and J2 v l( v ) = This modification 
will certainly not decrease the value for player II. Therefore, in Theorem 11.21 the 
assumption inf / > cannot be replaced by the assumption / > 0, even if F = 
throughout Y. 

Note that we may convert the discrete comb graph to a continuous length space 
by adding line segments corresponding to edges in the comb. It is then easy to define 
the corresponding continuous / and conclude that in Theorem 11.31 the assumption 
inf |/| > cannot be relaxed to / > 0. The details are left to the reader. 

Remark 5.4. The dependence of itn(0, 0) on the growth of {£ x } is somewhat surpris- 
ing. If {£ x } grows slowly enough so that J2x>o 1 = 00 > then un(0, 0) < 2, because 
(as remarked above) the Borel-Cantelli lemma implies that the strategy of always 
pulling up is guaranteed to terminate, and thus the proof of Lemma 15.11 applies. 
We have seen that for some sequences {£ x } of polynomial growth, Un(0, 0) can be 
arbitrarily large. However, if {£ x } grows rapidly enough so that £ x+ \/ £ x — > oo, then 
itn(0, 0) < 2. This is immediate from the following more general statement: for 
every k > 0, we have uu(0, 0) < 2 + 2£k Ylj>k ■ To prove this, suppose player II 
adopts the strategy of always pulling left when x t > k and y t — and up otherwise. 
Let ip(t, k) denote the payoff accumulated for player I at points in [0, k] x {0} up 
to time t. Then Eip(t, k) < 2, because 

M t = 2{l-p-) + 1>{t,k) 

is a positive supermartingale with Mq = 2. Then we claim that 

E[^(t)-V(*,fc)]<24^^ 1 . 

j>k 

Fix j > k. Starting at (fc,0), the expected number of visits to (j, 0) before 
returning to (k, 0) is at most 1 (by comparison to simple random walk). The 
expected number of visits to (A;,0) is at most 2£k, since each time (x t ,yt) = (k,0), 
there is a chance of at least l/(2£k) of terminating at (k, Ik) without returning to 
(k, 0). Thus the expected accumulated payoff at (j, 0) is at most 2£k£j 1 ; summing 
over j > k proves the claim. 

5.2. Positive Lipschitz function with multiple AM extensions. Here we 
show that uniqueness in Theorem 1 1 . 41 may fail if F is unbounded, that is, we give 
an (X, y, F) (here / = 0) for which F is Lipschitz and positive and the continuum 
value is not the only AM extension of F, 

Let T be the rooted ternary tree, where each node has three direct descendants 
and every node but the root has one parent. Let X be the corresponding length 
space, where we glue in a line segment of length 1 for every edge in T. For every 
node v in T, we label the three edges leading to descendants of v by 1, —1 and *. 
(One may interpret T as the set of finite stacks of cards, where each card has one 
of the three labels 1,-1, and *.) 
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Wc define a function w on the nodes of T by induction on the distance from the 
root. For any vertex v let k(v) be the number of edges on the simple path from the 
root to v whose label is not *. Set w(root) := 0. Next, if v is the parent of v' and 
the edge from v to v' is labeled ±1, then w(v') = w(v) ± 1, respectively. Finally, if 
the edge from v to v' is labeled *, let w(v') = w(v) + 1 — 2~ k ( v \ say. This defines 
w on the vertices of T . We define it on X by linear interpolation along the edges. 

Let Vq denote the set of nodes consisting of the root and all vertices v such 
that the edge from v to its parent is not labeled *. For each v £ Vq let b(v) be 
some large integer, whose value will be later specified, and let q(v) be the vertex 
at distance b(v) away from v along the (unique) infinite simple path starting at v 
which contains only edges labeled *. Let Y\ = {q(v) : v e Vb} and let Y be the set 
of all nodes v such that w(v) < 3/2. Set Y := Y U Y x . 

We first claim that w is AM on X \ Y. Indeed, let U be an open subset of 
X \ Y. If U docs not contain any tree node, then Lip u w = Lip du w, because w 
interpolates linearly inside the edges. Suppose now that v e U is a node. Let (3 
be the infinite path starting at v going always away from the root which uses only 
edges labeled —1. For each positive integer m let j m be the infinite path starting at 
v going always away from the root whose first m edges are labeled 1 and the rest are 
labeled *. Observe that 7 m meets Y\ and [3 meets Y . Consequently, -f m n dU ^ 
and f3 (~l dU ^ 0. If x\ G j m n dU and x e (3 n dU, then w(xi) - w(x ) > 
(1 — 2 _m ) d(xi, xq) by the construction of w. Thus Lip du w > 1. Since Lip x w = 1, 
this proves that w is AM on X \ Y. 

Next, we consider the discrete tug-of-war game on the graph T where / = and 
F is the restriction of w to Y. Let x , the starting position of the game, be the 
third vertex on the infinite simple path from the root whose edges are all labeled 
1. We claim that the value u\ for player I satisfies u\{x ) < w(x ). Before proving 
this we explain the idea: at each step, player I has one or two moves that increase 
the value of w by 1 (either moving away from the root along an edge with label 1 
— i.e., "adding a 1 card to the deck" — or moving towards the root along an edge 
labeled —1 — i.e., "removing a —1 card from the top of the deck"), and similarly, 
player II has one or two moves that decrease the value of w by 1. Player I can thus 
make w(xj) a submartingale by always making moves of this type. 

This does not force the game to terminate, however; in order to end the game 
favorably by reaching a point in Y\, player I must add a sequence of cards labeled 
* to the top of the deck. If player II adopts the strategy of always choosing the 
edge labeled —1 ("adding a —1 card to the deck"), then (provided that b(-) increases 
rapidly enough) the expected number of suboptimal moves that player I must make 
(by moving along an edge with label *) to reach any particular element of Y\ is 
large enough to significantly decrease the total expected payoff for player I. 

We proceed to prove that u\{xq) < w(x ). Let vo be a vertex in Vq \ Y, which 
is in the same connected component of T \ Y as xq. Let (vo,Vi, . . . ,Vt,( Vo )) be 
the simple path from v to q(v ). We now abbreviate n = b(v ), h = w(v ) and 
a = 1 - 2- k( * V0 \ 

Let player II use the naive strategy of always trying to move from the current 
state along the edge labeled —1 going away from the root. For i e {0,1, ... ,n} 
let n be the first time t such that x t — Vi, and if no such t exists let = oo. 
(As before x t is the game position at time t.) Let — w(x t ) for t < Tj and 

= w(vi-i) + 1 for t > Tj. Then is clearly a supermartingale, regardless 
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of the strategy used by player I. Since the game terminates at time t if w(xt) < 1, 
this implies that for i £ N+ 

n r I I . w(vi-l) 1 / -1 

Pr 71 < 00 71-1 < 00 < — ; : = 1— : : 7 < exp - — 

L 1 J ~ w(vi-i) + 1 h+(i-l)a+l - \h+(i-l)a+l, 

Consequently, 

Pr[r„ < 00] < JJPr[rj < oo | 7i_i < oo] < exp(- ^ 

i=l i=l \ 

- 6XP (-/ 



a + 1/ 

ds \ / h + l \ 1/0 



Therefore 



Pr[r„ < oo]F(«„) < (fc- 



fe+l + sa/ V a n + ft + 1 



na 



van + ft, + 1/ 

Since a < 1, we can make this smaller than any required positive number by 
choosing n — b(vo) sufficiently large. We may therefore choose the function b : 
V — > N + so that 

Pr[game ends at u] F(v) < 1/2 . 

veY t 

Since F < 3/2 on Y , this implies ui(xo) < 2 < 3 = w(xo). 

Let be the linear interpolation of u\ to the edges. By Lemma 11.11 u\ is 
discrete oo-harmonic. It follows that in the Il-favored e-tug-of-war game, for every 
S > and e S (0, 1/2) player II can play to make u*(xt) + 2~*<5 a supermartingale. 
Consequently, Lemma |3 . 31 implies that the value of the continuum game is bounded 
by mi on the vertices. Since the continuum value is AM on X \ Y, by Theorem 1 1.41 
this proves our claim that the assumption sup F < oo is necessary for uniqueness 
to follow in the setting of that theorem. 

5.3. Smooth / on a disk with no game value. The following example is a 
continuum analog of the triangle example at the beginning of Section [2.21 

Let X be a closed disk in K 2 , and let Y = dX be its boundary. We now show 
that for some smooth function / : X — ► K, the value uf for player I and the value 
Ujj for player II differ in e-tug-of-war with F = on Y. Not only are the values 
different, but the difference does not shrink to zero as e \ 0. There is a lot of 
freedom in the choice of the function /, but an essential property, at least for the 
proof, is that / is anti-symmetric about a line of symmetry of X . 

It will be convenient to identify M 2 with C, and use complex numbers to denote 
points in R 2 . Let / be a C°° function such that: 

(1) / > 1 inside the disk \z - 1| < 1/2, 

(2) < / < 2 in the right half plane Re z > 0, 

(3) / = in {z e C : Rez > 0, \z - 1| > 11/20}, and 

(4) / is anti-symmetric about the imaginary line. 

Let R > 2 be large, let X = {z : \z\ < R}, Y = {z : \z\ = R} and F — on Y. 
Consider e > small. We want to show that for an appropriate choice of R, then 

(5.1) liminf ||u : - Unlloo > . 

e\,0 

Indeed, suppose that this is not the case. Let S > be small, and suppose that 
ll M i — u iilloo < S. Symmetry gives uf(x +iy) = — itf I (— x + iy). The assumption 
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Ujjljoo < 6 therefore tells us that \uf(x + iy)+uf(—x + iy)\ < S. In particular, 
|uf| < 2 6 on the imaginary axis. We now abbreviate w = uf. Clearly w > —5 on 
{z G X : Rez > 0} and w < 6 on {z G X : Rez < 0}. By considering strategies 
which pull towards the imaginary axis and then using whatever strategy gives a 
value in [—2 5, 2 S] it is easy to see that \w\ = 0(1) (as usual, / = O(g) means that 
there is some universal constant C such that / < C g) and that \w\ < 0(6 + e) in 
{z G X : | Rez| < 2e}, say. (See, e.g., the proof of Lemma \3. 51 ) It is then easy to 
see that there is a constant c\ > 0, which does not depend on R and e (as long as e 
is sufficiently small and R > 2, say) such that w > c\ on the disk \z — 1| < 3/4 and 
w < — c\ on the disk \z+ 1| < 3/4. Since w is nearly anti-symmetric, it is enough to 
prove the first claim. Indeed, a strategy for player I which demonstrates this is one 
in which she pulls towards 1 until she accumulates a payoff of 1. If successful, she 
then aims towards the boundary Y , but whether successful or not, whenever the 
game position comes within distance e of the imaginary axis, she changes strategy 
and adopts an arbitrary strategy that yields a payoff 0(5 + e). We assume that S 
and e are sufficiently small so that the 0(S + e) term is much smaller than c\. 

It now easily follows from Theorem [131 that \w(z)\ < 0(1) |z| -1 / 3 + 0(S + e). 
Consequently, there is some constant r\ > 2 such that \w\ < ci/10 on {z E X : \z\ > 
ri}, provided that e + S is sufficiently small. Set L — ci/(8ri), and let Zl = Z £ L 
be the set of points z E X such that 

sup{w(z') : z' G B z {e)} -mi{w{z') : z' G B z (s)} >2Le. 

Since | to | < ci/10 on \z\ = r x and \w\ > c x on S := {\z-l\ < 3/4}U{|z + I| < 3/4}, 
it follows that every path in the graph (X, E e ) from S to Y must intersect Z^. (We 
are assuming R > r±.) Let Zl denote the union of Zl and all connected components 
of (X \ Zl, E e ) that are disjoint from Y . 

We now claim that there is some T2 > r\ (which does not depend on e) such 
that Zl C {\z\ < r 2 } and therefore Zl C {\z\ < r 2 }. Indeed, if zi,z 2 G X satisfy 
\zi — Z2 1 < £ and \z±\ > 3ri, say, then the strategies for either player of pulling 
towards z 2 and only giving up when the current position is within distance e of 
\z\ = r\ show that 

M*0 " W{z ^\ ± |z 1 |-r 1 -2£ ^ W ^\ ■ W > r ^ * \z.\-n-2s Cl/1 ° • 

This proves the existence of such an r 2 . 

We now let player II play a strategy very similar to the backtracking strategy 
she used in the proof of Theorem 12. 2\ which we presently describe in detail. Let 
xq,x\, . . . denote the sequence of positions of the game. Assume that xo G Zl- 
For each t G N, let j t := max-jj G N : j < t, Xj G Z L }- Note that if j t < t, then 
Xj t G Z L - By Lemma H~T1 inside {z G X : \z - 1 \ > 3/4, \z+ 1| > 3/4} the function 
w satisfies AooW = 0. If xt G Zl and player II gets the turn, she moves to some 
z G B Xt (e) that satisfies w(z) < mi{w(z') : z G B Xt (e)} + 52^ 1 . While if x t £ Z L 
and player II gets the turn, she moves to any neighbor z of xt that is closer (in the 
graph metric) to Xj t than Xt in the subgraph Gt of (X, E £ ) spanned by the vertices 
x 3t > x h+l-> ■ ■ ■ i x t- 



34 YUVAL PERES, ODED SCHRAMM, SCOTT SHEFFIELD, AND DAVID B. WILSON 

Now consider the game evolving under any strategy for player I and the above 
strategy for player II. Let dt be the graph-distance from xt to Xj t in Gt- Set 

t 

m t := w{x jt )+d t eL + S2- t + f(%k) ■ 

As in the proof of Theorem 12.21 it is easy to verify that w(x t ) < m t and that m t is 
a supermartingale. 

Let r be the time in which the game stops; that is, r := inf{£ e N : x t E Y}. 
Assume that r < oo a.s. Suppose that we could apply the optional stopping time 
theorem. Then we would have 

w(x ) > E[m T ] = E[w(x jr ) +5 2~ T ] +eLE[d T ] +E [payoff]. 

Thus, 

E [payoff] < 0(1) - e LE[d T ] . 

But d T > (R — ri)/e, because the Euclidean distance from Y to Zl is at least 
R — T2- Since w(xq) is at most the supremum of expected payoffs under the current 
strategy for player II and an arbitrary strategy guaranteeing r < oo for player I, 
we obtain w(xq) < O(l) — R + 7'2. This contradicts our previous conclusion that 
\\M\oc = O(l), because we may choose r large. 

How do we justify the application of the optional stopping time theorem? We 
slightly modify the strategy for player II. So far, our analysis utilized one advantage 
to player II in the calculation of w = uf; that is, that it is player I's responsibility to 
make sure that r < oo. Now we have to use the other advantage to player II, which 
is that player II gets to choose her strategy after knowing what player I's strategy 
is. Let to be the first time such that with the strategy which player I is using and 
the above strategy for player II, the game terminates by time to with probability 
at least 1/2. The new strategy for player II is to play the above strategy until time 
to, and if the game lasts longer to use an arbitrary strategy which would guarantee 
a conditioned expected future payoff of ufi(xt ) = 0(1). We may certainly apply 
the optional stopping time theorem at time r A to- This does give a contradiction 
as above, because E[<f rA t ] > (R — r2)/(2e), and the contradiction proves our 
claim (|5Tj) . 

5.4. Lipschitz g on unit disk with multiple solutions to A^u — g. Here we 
construct the counterexample showing that if we omit the assumption inf / > 0, 
in Corollary 11.91 then it may fail. In the example, X is the unit disk in R 2 , Y 
is its boundary, F = and / is Lipschitz and take values of both signs. The 
example is motivated by and similar to the example of Section [5.31 However, since 
the assumptions of Corollary 1 1.91 do not hold (obviously), we need to construct the 
solutions u to AqcU = g not by using tug-of-war, but by other means. In fact, we 
will use a smoothing of Aronsson's function (|4.1|) . 

The following analytic-geometric lemma will replace the use of the backtracking 
strategy for player II in Section 15.31 The following notation will be needed. For 
x e U and u : R — > M let 

Lip^u := infjLip^/U : x G W C U, W open} . 

Lemma 5.5. Let X be a length space, and let Fi,F% be bounded Lipschitz real 
valued functions on a nonempty subset Fcl. Let U\ and U2 be the corresponding 
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AM extensions to X \Y . Fix L > 0, and let Zl '■= {x G X : Lip^-ui > L}. Suppose 
that F\ = F2 on Zl H Y , that Lipy,^ i*2 < L and 

(5.2) mp { Jj^gM :yeY^Z L , X eZ L }<L. 

Then u± = U2 in Zl. 

We need a few simple observations before we begin the proof. Suppose that U 
is an open connected subset of a length space X, that X \ U is nonempty, and 
that F : X \ U — > R is Lipschitz and bounded. Let dU denote the set of all 
points x € <9?7 such that there is a finite length path 7CI where 7 n U ^ and 
7 \ J7 = {a;}. Set J7* := [/ U dU and for two points x,y £ U* let d*(a;, y) = d^(x, y) 
be the infimum length of paths 7 C U* joining x and y such that 7 n dU is finite. 
Note that (£/*, d*) is a length space. Also, since c!, > d on [/, x 17*, the restriction 
of F to <9J7 is Lipschitz. Consequently, this restriction of F has an AM extension 
u : U* — ► R with respect to d*. Wc claim that this is also an AM extension of F 
with respect to d. 

Observe that for any Lipschitz function w : V — ► R where V C X is open, we 
have 

Lipy w < I sup Lipj.w ) V (LipgyU?) . 

(This can be verified by considering for every pair of distinct points x, y G V the 
restriction of w to a nearly shortest path joining x and y in A.) Hence, to show 
that u is AM with respect to d it is enough to prove that 

(5.3) sup Lip^w < Lip a y w 

xev 

holds for arbitrary open V C U. Observe that for x G U we have Lip^w = Lip*w, 
where Lip* refers to d*. Since w is AM with respect to d*, we have Lip*u> < LipgyW 
for all x G V. Finally, Lip^yW < Lip^yUi because d* > d on J7* x U*. This 
proves (|5.3[) and thereby shows that w is AM on J7 with respect to d. In particular, 
we conclude that 

(5.4) LipJ^iu = Lip-^iu 
for the AM extension of F to J7. 



Proof of Lemma [575[ First, it is clear that Zl is a closed set. Let 



ui(ar) , x G Z L , 



and let w : X — > R be the AM extension of F* to X \ (Y U Z L ). We claim that 
w is also an AM extension of F2 : Y — ► R to A \ F. Since uniqueness of AM 
extensions holds in this setting, this will imply w = ui and complete the proof, 
because w = u\ on Zl- 

Let U be a connected component of X \ Zl, and let d* = d^ denote the cor- 
responding metric on U U dU . Note that Lip-^ui < L, since Lip^ui < L for 
1 £ X \ Z;,. By (|5.2p and the assumption Lipy xZ F2 < L it follows that that 
^Pic/ucmc/)^* — ^' Thus, we get Lip x w; = Lip*w < L for x G J7, which implies 
Lip^ < L for x G X \ Z^. 
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Now let V C X \ Y be open. In order to prove that w is AM, we need to 
establish (|5.3p . Without loss of generality, we assume that V is connected. If 
V n Z L = 0, then certainly holds, since w is AM in X \ (Z L U V). 

Suppose now that Vfl 7^ 0- Then L\ := Lipyiii > L, by the definition of Zl- 
Since Ui is AM, by (15. 4|) with Hi in place of w, in place of £7 and djf in place of 
e^, there is a sequence of pairs (xj,yj) in dV and a sequence of paths 7^ cVil dV 
from aij to yj, respectively, such that Xj ^ yj, 

(5.5) hm \Mx 3 )-My 3 )\ = Li 

i^oo length (7^) 

and 7j (~1 9V is finite. For all sufficiently large j, \ux(xj) — u\(yj)\ > L length^). 
Hence jj n Zl ^ 0. Let a;'- be the first point on jj that is in Zl and let y'j be 
the last point on 7,,- that is in Zl- Note that d(x'j, Xj)/ length^*) — ► as j — > 00, 
because L < L\ = Lipytti, (|5.5|) holds and \u(x'j) — u(xj)\ < Ld(x'j,Xj). (If at 
some significant proportion of the length of jj the function u does not change in 
speed very close to L%, it will not have enough distance to catch up.) Similarly, 
length^-) -> 0. Since sup x £ Zl Lip x «i < L and sup x g Zl Lip x w < L 
and Ui = w on Z^, it follows that \u\{xj) — w(xj)\ < 2Ld(xj,x'j) and similarly 
Kfe) - w (yj)\ < 2.Ld(t/j,2/j). Thus, |tw(xj) - length (7^) -> ii, proving 

that Lip a yW > Lip v u>, as needed. □ 

Our example is based on smoothing two different modifications of Aronsson's 00- 
harmonic function G from (|4.1[) . For L > let be the set of points in R 2 \ {0} 
such that \VG\ > L. Define the inner an outer radii of Zl- Rl := sup{|z| : z 6 Zl} 
and tl :— inf{|z| :0^z^ Zl}, and note that Huil^oo Rl — 0, while tl > for 
every L > 0. Now fix some large L. Let it denote G restricted to the annulus 
A L := {z€l 2 : r L /2 < \z\ < 1}. Let Uj, j = 1,2, denote the AM function on A L 
whose boundary values are equal to u on the inner circle and are j on the outer 
circle, respectively. Lemma [5.51 implies that u± — u — u-i on Al H Zl (provided 
that L was chosen sufficiently large). Shortly, we will show that there is a function 
v defined on the unit disk that agrees with u in Al and such that A^v = g (in the 
viscosity sense), where g is a Lipschitz function. Assuming this for the moment, we 
can then define Vj = Uj — j in Al and Vj = v — j inside the disk \z\ < Tl/2. Then 
V\ and V2 are both on the unit circle, and both satisfy A^Vj = <?, providing the 
required example. It thus remains to prove 

Lemma 5.6. For every ro > there are Lipschitz functions g,v : R 2 — > M such 
that v agrees with G on \z\ > ro and A^v = g holds in the viscosity sense. 



'(1- |tan(6»/2)| 4 / 3 ) 2 



1/3 



Proof. Let 

a(0) '~ [1 + I tan(fl/2)| 4 /3 + I tan(0/2)| 8 / 3 _ 

be the angle factor of G in (|4.ip . First, observe that a(9 + n) = —a{&) and o(— 0) = 
a{9). Next, note that a{9) > when 6 £ (— 7r/2,7r/2). We now verify that a(0) is 
C°° in a neighborhood of n/2. Write 

a(9) = cose fl + I tan W 2)| 4 / 3 + | tan( g /2)| 8 / 3 ) ( 1 = 1 ) 2/3 . 

\ / V cost/ / 
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The first two factors are real-analytic near tt/2. Setting (p = | tan(6>/2)| 2 /3, which 
is real- analytic near 9 = tt/2, allows us to rewrite the last factor as 

-4/3 ( l + if \ 2 / 3 
ip + ip 2 

which is also real-analytic near 9 = tt/2. We conclude that a(9) is real-analytic at 
every 9 (£. tt Z. 

It is instructive to see that G is co-harmonic in R 2 \ {0}. Verifying A^G = 
away from the real line can be done by differentiation. At points where 9 = 0, r > 0, 
we have VG/|VG| = (-1,0). At such points <9 2 G = d^r' 1 / 3 = 4r~ 7 / 3 /9, and 
indeed A+ G = 4r~ 7 / 3 /9 there. However, 

(5.6) a{9) = 1 - 16~ 1/3 4/3 - 9 2 /6 + 0(9 3 ) , 

near 9 = 0. This implies that there is no G°° function u that satisfies u(r, 0) = 
G(r, 0) and u < G in a neighborhood of (r, 0). Thus, A^G = — oo. 

We return to the proof of the lemma, and first establish that the lemma holds 
when we only require that g be continuous, instead of Lipschitz. In this case, the 
function v may be written as 

(5.7) v(r, 9) := tp(r) (A(r) a{9) + (1 - A(r)) cos 9) 

for appropriately chosen functions ip and A. The functions ip and A will be G°°, will 
satisfy A(r) = tp(r) = in a neighborhood of and tp(r) = r -1 / 3 , A(r) = 1 for all 
r — r o/2. It follows that v is Lipschitz and that A^v is G°° away from the x-axis 
and in a neighborhood of 0. It remains to check the behavior of A^v at points on 
and close to the x-axis. Based on (|5.6p . we may estimate A^v for 9^0 close to 



and r > 0: 

(5.8) A,,!, = v " - —— 7- + ' " : '::r;,r* : * ^ ' ; > <m. 



4AV P(r,\,<p,<p',\') fl2/3 
81r 4 ((^') 2 r 6 (^') 4 



where P is some polynomial. Let r\,r2, r% satisfy < r§ < r% < r\ < ro/2. Choose 
A(r) as a G°° function that is for r < r 2 , is 1 for r > r\, and is strictly monotone 
in [ra, ri]. Choose y(r) as a G°° function that is in [0, 7-3] and is r -1 / 3 for r > r-2. 
When r < r 2 , A = 0, and hence A^v is G°° by (|5.7|) . In the range r £ [r2,rx], we 
use (|5.8|) to conclude that the limit as 9 — > of A^v exists. 

We now argue that there is a continuous function g such that A^v = g in 
the viscosity sense. Suppose that 77 is a G 2 function defined in a small open set U 
containing the point zq = (r, 0) such that the minimum of 77— v in U occurs at zq. We 
will now perturb r\. For sufficiently small s\ > the function 771(2) := ?7 + si |z — zo| 2 
is a G 2 function defined in U and zo is the unique minimum of 771 — v in U . If 
S2 > is chosen much smaller, then the function 772(2) = rii{z) + 82 y will still 
satisfy that the infimum of 772 — v is attained in U. Moreover, that infimum cannot 
be attained on the x-axis, because S2 y is zero on the x-axis, Vy is not parallel 
to the x-axis, and Vt; exists. Since s 2 and si are arbitrarily small, we conclude 
that A oa r](zo) > lim z A oa v(z) as z tends to zq through point not on the a;-axis. 
Thus, A^ a v(zo) > lim z A 00 v{z). Similarly, A^t;(;zo) < lim z A oc t;(z). This proves 
AooV = g, where g is the continuous extension of A^v off the cc-axis to the whole 
plane. 
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If we want g to be Lipschitz, we need to eliminate the 2 / 3 term in (15. 8)1 . Define 
ai (6) := -16 1/3 (a(6) - cos0 - (1/12) sin 2 20) , 
a 2 (0) :=cos0 + (l/8) sin 2 2(9, 
a 3 (8) := (1/4) sin 2 26 . 
Then near 6* = we have 

ai (0) = 4/3 + O(0 3 ), 
a 2 (0) = l + O(0 3 ), 
a 3 (0)=0 2 + O(0 3 ). 

Set 

(5.9) «(r, 0) := Ai(r) ai(0) + A 2 (r) a 2 (0) + A 3 (r) a 3 (0) , 

where Ai, A 2 and A3 are to be chosen soon. A calculation shows that near 9 — we 
have 

64 A 3 

A ^ = A2 + 8i7W + 

64 A| - 162 r 4 (A 2 ) 3 + 27 r 2 Ai (A 2 ) 2 (3 r 2 A 2 ' + 3 r A 2 - 10 A 3 ) fl2/3 

" 16Al 7297W ( } ' 

Of course, when Ai, A 2 and A3 are chosen so that v = G, all the terms on the right 
hand side vanish. Our goal is to choose these functions so that the following holds: 

(1) for r > ro we have v = G, 

(2) when r is sufficiently small, we have v = 0, 

(3) the # 2 / 3 term vanishes identically, 

(4) we don't have a blow up due to A 2 = 0, and finally 

(5) the functions Xj are C°°, say. 

This is not hard. Fix n, r 2 , r3, Vi such that < < r 3 < r 2 < n < ro/2. For 
r > r 1; we choose the A^ so that v = G. In particular, A 2 = r -1 ' 3 in this range. 
In the range r > r 3 we maintain A 2 = r _1//3 . The function Ai is chosen so that 
throughout [?* 3 ,r 2 ] we have Ai = A 2 , while Ai does not vanish in [r 3 ,ri]. This is 
possible, because A 2 < for r > r 3 and Ai = — 16 -1 / 3 < at r = n. For every 
r G [r 3 , n], A 3 (r) takes the unique value for which the 2 / 3 term vanishes. Since Ai 
and A 2 do not vanish in the interval, it is clear that such a choice for A 3 is possible 
and A 3 is C°° provided that Ai and A 2 are. Throughout r < r 2 we take Ai = A 2 . 
This allows us to simplify the expression for A^v in this range, to obtain 

A 1 64 A2 1 1fi 270r 2 A 3 -(64 + 8lr 3 )A 2 + 8lr 4 A" 2/3 
A ^-A 2 + ^ T7T + 16 ^ 9' +0(9). 

Now the denominators cannot vanish before r = 0. Thus, A 3 takes care to make 
the 2 / 3 term vanish while A 2 evolves to become zero throughout r < r±. This 
completes the proof. □ 

6. Viscosity solutions and quadratic comparison in K" 

In this section we prove Theorem II. 71 which states that in bounded domains in 
Euclidean space K. n , u is a viscosity solution of AqqU = g iff u satisfies (/-quadratic 
comparison. The following lemma will be useful in that proof. Let D 2 ip(x) denote 
the Hessian matrix (didj(p{x))\_^ 



TUG-OF-WAR AND THE INFINITY LAPLACIAN 



39 



Lemma 6.1. Let ip be any real-valued function which is C 2 in a neighborhood of 
xo € K™ and satisfies Vip(xo) ^ 0. Then for every S > 0, there exist quadratic 
distance functions ifi and <p 2 such that: 

(1) ipi(x ) = ip(x ) = ip 2 (x ); Vipi{x ) = Vip(x ) = Vip 2 (x ). 

(2) < \A 00 ifi(xo) — A 00 (p(xo)\ < S for i e {1,2}. Also, as quadratic forms, 
D 2 <p 2 (x ) strictly dominates D 2 ip(xo), which in turn strictly dominates 
D 2 tp 1 (x ). 

(3) Consequently, ip\ < ip < ip 2 at all points x ^ xq in a neighborhood U of xq. 

(4) <pi and ip 2 are centered at Z\ and z 2 , respectively, with < \zi — x \ < 5 for 

is {1,2}. 

(5) In a neighborhood ofx , the function ipi is *- decreasing in the distance from 
Z\ and ip 2 is * -increasing in the distance from z 2 . 

Proof. We begin with preliminary calculations about the quadratic distance func- 
tion ip a ^(x) — a\x\ 2 + b\x\, centered at the origin. Fix some x ^ 0. Let v = x/\x\ 
be the unit vector in the x-dircction and vo be any unit vector orthogonal to v. 
Write M = M{x) = D 2 p a . b {x). 
Then direct calculations show: 

(1) Vip a ,b{x) = (2a|a;| + 6)u. 

(2) v T Mv = 2a. 

(3) v^Mvo = 2a + 6|a;|- 1 . 

(4) v^Mv = 0. 

(5) A 00 <p 0i6 (a;) = 2a whenever Vip a . b (x) ^ 0. 

Of course, it is enough to complete this calculation in dimension two when x = (1,0) 
and a = 1 and deduce the general case by symmetry. 

We now construct the ip 2 described in the lemma (the construction of ipi is 
similar). We will take z 2 = x — 7 |v^(z°)l ^ or some sman value of 7 > (specified 
below) and write <p 2 (x) = p a ,b{x — z 2 ) + c, where we first choose a to be an arbitrary 
real with the property that < 2a — A 00 y)(a;o) < 6, we then choose b so that 
Vip 2 (xo) = Vip(xo) and we then choose c so that p> 2 (xq) = <p{xq). We must now 
show that the ip 2 thus constructed satisfies the requirements of the lemma. 

We can compute b explicitly in terms of a, x , W(p(x ), 7, and z 2 using the 
relation \7ip 2 (x ) = (2aj + b) = V(/?(x ). As 7 tends to zero, b tends to 

|Vy?(x )|. 

The description of D 2 (p a ^(x) given above implies that if v = (xo — z 2 )/\xq — z 2 \ 
and vo is a unit vector orthogonal to v, and M = D 2 ip a ^(xo), then 

(1) v T Mv = 2a. 

(2) v^Mvo = 2a + bj- 1 . 

(3) v T Q Mv = 0. 

Note that \ VqMvo = 2a + bj~ x = 7 _1 |V</?(xo)| tends to 00 as 7 \ 0. 
Let M' := D 2 ip(xo). We claim that by choosing 7 sufficiently small we can make 
sure that M dominates M' as a quadratic form (or any other fixed quadratic form 
satisfying v T M'v < 2a, for that matter). Let C := sup{wqM'wi : Wo,Wi £ 
R™, |wo| = \w\\ — 1} and a' := v T M'v/2 < a. If w e M" is nonzero, we may write 
w = av + wo, where a£l and wo is orthogonal to v. Then 

w T M'w < 2a a 2 + 2C'a\w \+C\wo\ 2 . 
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On the other hand w T A/u; = 2aa 2 +x\wo\ 2 ■ Since 2 C a \ wo | < ^f- a 2 + C \w 1 2 
for some constant C = C'(C,a,a'), the domination follows from lim 7 \^o X = 00 • 
This constructs p>2 with the required properties. A similar construction applies to 
<pi. □ 

Proof of Theorem \1.7\ Let x G U and suppose that u satisfies (/-quadratic com- 
parison in a neighborhood of Xq. Let ip be a C 2 real valued function defined in a 
neighborhood of x$. Suppose that Vip(xo) ^ and p—u has a local minimum at Xq. 
The above lemma implies that for every 5 > there is a quadratic distance function 
fi{x) = a \x — z\ 2 + b \x — z\ such that P2{x) — p{x) > ^2(^0) — ty?(#o) f° r a U x x a 
in some neighborhood of xq, A 00 <^2 < A-ooP+S and tf2 is ^-increasing in a neighbor- 
hood of xq. Since P2 — U has a strict local minimum at Xo, it follows by (/-quadratic 
comparison that arbitrarily close to xq there are points x for which a > g(x)/2. By 
continuity of g, this implies a > g(xo)/2. That is, A^t^C^o) > fl(^o)- Since <5 > 
was arbitrary, this also implies A OQ (p(xo) > g(xo). 

Now we remove the assumption that Vp(xo) ^ and assume instead that p(x) — 
a \x — xq\ 2 + o{\x — xq\ 2 ) as x — > xq. If a > 0, we may take ^(x) = (a + 8) \x — £o| 2 , 
and the same argument as above gives A 00 </?(a;o) > g(xo). Now suppose a < and 
let (5 S (0, |o|). In this case, we have to modify the argument, because if2 is not 
★-increasing in a neighborhood of Xq. Recall that p — u has a local minimum at 
Xq and P2 — P has a strict local minimum at xq- Therefore, (p2 — u has a strict 
local minimum at xq. Let r > be sufficiently small so that <fi2{%) ~ u(x) > 
<fi2(xo) — u(xo) — —u(xq) on {x G R" : < |x — xq\ < r}. By continuity, for 
every 77 G M" with \r]\ sufficiently small p2(x + 77) — u(x) > —u(xq) for every 
.x G dB Xo (r). Fix such an 77 satisfying < \r)\ < r, and let x* be a point in B Xo (r) 
where p2{x + v) ~ attains its minimum. Since 

¥>2(a;o +77) - u(x ) < -u(x ) < inf{^ 2 (a; + 77) - u(x) : x G dB Xo (r)}, 

it follows that a;* ^ dB Xo (r). On the other hand, x* 7^ xq — 77, because 

^((xo - rj) +rj) - u(x Q - 7/) = -u(x - rf) > -p%{xo - v) ~ u ( x o) > -u(x ) . 

Therefore, V^aO^*) 7^ 0. The first case we have considered therefore gives g{x*) < 
Aoo<^2(^*) = 2 (a + S). Since S G (0, \a\) was arbitrary, continuity gives g(xo) < 2a, 
as required. Thus, we conclude that A+^u > g. By symmetry, A^it < g, and hence 
u is a viscosity solution as claimed. 

This completes the first half of the proposition. For the converse, suppose that 
it is a viscosity solution of AqoTj = g. Let W G W G U be open. Suppose that 
p{x) — a \x — z\ 2 + b \x — z\ + c is a ^-increasing quadratic distance function in 
W, p > u on and there is some xo & W such that u(xq) > <p(x$). For all 
sufficiently small S > we still have (,25(2;) := p(x) — S \x — z\ 2 > u on Let 
x* be a point in W where ps{x) — u{x) attains its minimum. Note that x* ^ dW , 
since ^(xo) — 7j(xo) < p{xq) — u(xq) < 0. Consequently, g(x*) < A+ u(x*) < 
A 00 (/?5(x*) = 2 (a — S). Thus, 2a > infwg. Therefore, u satisfies (/-quadratic 
comparison on W, and the proof is complete. □ 

7. Limiting trajectory 

7.1. A general heuristic. For every e, when both players play optimally in e-tug- 
of-war, the sequence {xt} of points visited is random. Do the laws of these random 
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sequences, properly normalized, converge in some sense to the law of a random 
continuous path as e tends to zero? 

We give a complete answer in only a couple of simple cases. However, we can 
more generally compute the limiting trajectory when u is C 2 in a domain contained 
in W 1 and the players move to maximize/minimize u instead of u e ; we suspect but 
cannot prove generally that the limiting behavior will be the same when the players 
use u £ . 

Consider a point xo in the domain at which Vu(xo) =/= 0. If e is small enough, 
then Vu ^ throughout the closed ball B e (xo), so the extrema of u on the closed 
ball B £ (xq) lie on the surface of the ball. Then at any such extrcmum x, by the 
Lagrange multipliers theorem, x — xq = AVu(x) for some real A = O(s). Since 
u is C 2 , we have Vu(x) = Vu(xo) + -D 2 u(xo)(x — x ) + o(e), where D 2 u(xq) = 
(didju(x )) 1 JZ 1 '^^. We define rj = Vu(x ), H = D 2 u(x ), and c = rj T Hr]/\rj\ 2 . 
Then x — x = X(ij + H(x — x ) + o(e)), where A = 0(e). If we solve this with small 
A, we find 

x-x = (I- Aff) _1 A(»j + o(e)) = Xtj + X 2 Hr] + o(e 2 ). 

Then e 2 = |x-x | 2 = M 2 A 2 + 2c|f7| 2 A 3 + o(e 3 ), and thus ±e = HA + c|?7|A 2 + o(e 2 ), 
and so A = ±e/|ry| — e 2 c/\r]\ 2 + o{e 2 ). Hence, 

x - x = ±e\i]\- 1 r] + e 2 \i]\- 2 {H - cl)t] + o(e 2 ). 

When u is 2 and has nonzero gradient in a domain, this suggests the SDE: 

(7.1) dX t = r{X t )dB t + s(X t )dt, 

where r(X t ) = \ WuiXt^WuiXt) and s(X t ) is equal to \Vu(X t )\- 2 D 2 u{X t )\7u(X t ) 
minus its projection onto Vu(X t ) (so that r(X t ) and s(X t ) are always orthogonal). 
Now Ito's formula implies that, as expected, u(X t ) — \ Jg—o ^oo u (X s ) ds is a mar- 
tingale. In particular, when u is infinity harmonic, u(X t ) is a martingale. 

All of the above analysis applies only when players make moves to optimize u — 
instead of u e , as they would do if they were playing optimally. This difference is 
what makes the calculation of the limiting trajectory a heuristic, except in a few 
special cases as described in the next subsection. 

7.2. Special cases. The above analysis does apply to optimally played games in 
a couple of simple cases for which u — u e . Let X = M 2 and let Y C X be the 
complement of a bounded set. Then the following are infinity harmonic functions 
u which satisfy both AooW = and Af^u = 0: 

(1) u(v) is the distance from v to a fixed convex set whose e-neighborhood is 
contained in Y 

(2) u(v) is the argument of v on a 2 e-neighborhood of X \ Y, and defined 
arbitrarily elsewhere (here we assume that the 2 e-neighborhood of X \ Y 
does not contain a simple closed curve surrounding 0, so that the argument 
can be defined there). 

(Due to boundary errors the above need not hold when X \ Y is a bounded domain 
and Y is its boundary.) In the first case, Xt is simply a Brownian motion along a 
(straight) gradient flow line of u. In the second case, X t is a diffusion with drift in 
the — Xt direction and diffusion of constant magnitude orthogonal to X t . 
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Crandall and Evans [lOj have explored the following question in some detail, and 
it has recently been answered affirmatively by Savin [23] when n = 2: Is every oo- 
harmonic function on a domain in R™ everywhere differentiable? This question can 
be rewritten as a question about the amount of variation of the optimal direction of 
the first move (as a function of the starting point) in e tug-of-war. An affirmative 
answer might be a step towards a more complete analysis of the limiting game 
trajectories when / = and when u is not smooth, since it would at least ensure 
that r(X t ) is well-defined everywhere that the gradient is non-zero. 

8. Additional open problems 

(1) If U C E n is open and bounded, F : dll — > E Lipschitz, g : U -> K Lips- 
chitz, is there a unique viscosity solution for Aqo it = g + c with boundary 
values given by F for generic cel. Here, generic could mean in the sense 
of Bairc category, or could mean almost every, or perhaps this is true except 
for a countable set of c. 

(2) Does Theorem l 1 . 8l continue to hold if F and / are merely continuous instead 
of uniformly continuous? Can the inf |/| > requirement be replaced with 
/ > (or / < 0) when X has finite diameter? When solving A^u = g 
on bounded domains in R™, can the condition that g be continuous be 
replaced with a natural weaker condition (e.g., semicontinuity or piecewise 
continuity)? 

(3) In Section [5721 we gave a triple (X, Y, F) with F positive and Lipschitz for 
which the continuum value of tug-of-war is not the unique AM extension 
of F. 

Is there an example where X is the closure of a connected open subset 
of R n and Y is its boundary? In particular, let X be the set of points in R 2 
above the graph of the function let Y be the boundary of X in R 2 , 

and let F(x, y) = y on Y. Is y the only AM extension of F to XI What is 
the value of the corresponding game? (Note added in revision: Changyou 
Wang and Yifeng Yu (personal communication) have recently shown that 
y is the only AM extension of F to X . The proof turned out to be rather 
simple.) 

(4) Suppose that u : U — > R, is Lipschitz and g\ , <?2 : U — ► R are continuous 
on an open set U C R n and that A^u = gi as well as Aooit = g2, both in 
the viscosity sense. Does it follow that gi — <?2? (Note added in revision: 
Yifeng Yu [5S] proved this in the case n = 2.) 
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